Sep 17 18:10:06.264641 ip-10-0-137-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 18:10:06.264654 ip-10-0-137-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 18:10:06.264665 ip-10-0-137-166 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 18:10:06.264902 ip-10-0-137-166 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 18:10:16.324174 ip-10-0-137-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 18:10:16.324197 ip-10-0-137-166 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 4acf30236a9946e698492c6a1485f656 -- Sep 17 18:12:17.579176 ip-10-0-137-166 systemd[1]: Starting Kubernetes Kubelet... Sep 17 18:12:17.989996 ip-10-0-137-166 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:12:17.989996 ip-10-0-137-166 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 18:12:17.989996 ip-10-0-137-166 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:12:17.989996 ip-10-0-137-166 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 18:12:17.989996 ip-10-0-137-166 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 18:12:17.990681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.990075 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 18:12:17.994499 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994483 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:17.994499 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994498 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994502 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994506 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994508 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994511 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994516 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994519 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994522 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994525 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994528 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994531 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994534 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994537 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994539 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994542 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994544 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994547 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994549 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994552 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:17.994561 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994554 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994557 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994560 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994562 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994565 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994568 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994571 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994573 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994576 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994578 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994581 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994583 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994586 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994588 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994591 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994593 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994595 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994598 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994601 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:17.995018 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994603 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994606 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994608 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994611 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994613 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994617 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994620 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994623 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994626 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994628 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994631 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994635 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994639 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994641 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994644 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994647 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994650 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994653 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994656 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:17.995482 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994658 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994661 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994664 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994666 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994669 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994671 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994674 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994676 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994679 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994681 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994684 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994686 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994689 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994692 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994695 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994697 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994700 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994702 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994704 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994707 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:17.995947 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994710 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994712 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994716 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994719 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994721 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994723 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994726 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994728 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994731 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994734 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994737 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994740 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994742 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994745 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994747 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994750 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994752 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994754 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994757 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994759 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:17.996454 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.994762 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995440 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995447 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995450 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995452 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995455 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995458 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995460 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995463 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995466 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995468 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995471 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995474 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995476 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995479 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995481 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995484 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995487 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995489 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995492 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:17.996956 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995495 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995498 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995500 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995503 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995505 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995509 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995512 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995515 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995518 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995521 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995524 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995526 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995529 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995531 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995535 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995537 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995539 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995542 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995545 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995547 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:17.997447 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995550 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995553 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995555 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995558 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995561 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995563 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995566 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995569 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995571 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995574 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995576 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995579 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995581 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995584 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995588 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995592 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995595 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995598 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995600 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:17.997948 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995603 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995606 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995608 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995610 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995613 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995615 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995618 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995620 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995623 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995625 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995628 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995630 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995632 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995635 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995639 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995641 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995643 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995647 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995649 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995652 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:17.998425 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995654 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995656 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995660 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995664 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995667 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995669 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995672 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995674 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995677 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995679 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995682 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995684 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995687 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995689 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995692 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995694 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995696 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995699 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995701 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995704 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:17.998921 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.995706 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996106 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996112 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996115 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996118 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996122 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996125 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996128 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996130 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996134 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996137 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996140 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996143 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996145 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996148 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996150 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996154 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996158 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996162 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996164 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:17.999391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996167 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996170 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996172 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996175 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996177 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996180 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996182 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996185 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996187 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996190 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996192 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996195 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996197 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996199 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996202 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996204 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996207 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996209 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996212 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996214 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:17.999876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996217 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996220 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996223 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996225 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996227 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996230 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996233 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996235 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996238 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996240 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996243 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996245 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996248 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996250 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996252 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996255 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996257 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996259 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996264 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:18.000376 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996268 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996271 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996274 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996276 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996279 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996281 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996284 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996286 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996288 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996291 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996293 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996296 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996299 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996301 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996304 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996307 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996309 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996312 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996314 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996317 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:18.000876 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996320 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996322 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996329 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996332 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996334 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996337 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996339 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996342 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996344 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996347 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996349 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996352 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996355 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996357 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996360 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996362 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996364 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996367 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996370 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:18.001369 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996372 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.996374 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996436 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996467 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996473 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996478 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996482 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996487 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996491 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996495 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996499 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996502 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996505 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996508 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996511 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996515 2579 flags.go:64] FLAG: --cgroup-root="" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996518 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996522 2579 flags.go:64] FLAG: --client-ca-file="" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996525 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996528 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996533 2579 flags.go:64] FLAG: --cluster-domain="" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996535 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996538 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996541 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 18:12:18.001820 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996545 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996549 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996551 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996554 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996558 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996561 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996563 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996566 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996569 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996572 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996576 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996579 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996581 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996584 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996587 2579 flags.go:64] FLAG: --enable-server="true" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996592 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996598 2579 flags.go:64] FLAG: --event-burst="100" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996601 2579 flags.go:64] FLAG: --event-qps="50" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996604 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996607 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996609 2579 flags.go:64] FLAG: --eviction-hard="" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996613 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996616 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996620 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996623 2579 flags.go:64] FLAG: --eviction-soft="" Sep 17 18:12:18.002413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996626 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996628 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996631 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996634 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996637 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996640 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996642 2579 flags.go:64] FLAG: --feature-gates="" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996646 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996650 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996653 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996656 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996658 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996661 2579 flags.go:64] FLAG: --help="false" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996664 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996667 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996670 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996672 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996675 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996679 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996681 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996684 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996686 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996690 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 18:12:18.003006 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996694 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996697 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996700 2579 flags.go:64] FLAG: --kube-reserved="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996703 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996705 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996708 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996711 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996715 2579 flags.go:64] FLAG: --lock-file="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996717 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996720 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996723 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996728 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996731 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996733 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996736 2579 flags.go:64] FLAG: --logging-format="text" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996739 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996742 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996745 2579 flags.go:64] FLAG: --manifest-url="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996747 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996752 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996755 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996759 2579 flags.go:64] FLAG: --max-pods="110" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996761 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996764 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996767 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 18:12:18.003577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996770 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996773 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996776 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996778 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996785 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996788 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996792 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996795 2579 flags.go:64] FLAG: --pod-cidr="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996799 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996804 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996807 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996809 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996812 2579 flags.go:64] FLAG: --port="10250" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996815 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996819 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0429e2f6e642f0e4f" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996823 2579 flags.go:64] FLAG: --qos-reserved="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996825 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996828 2579 flags.go:64] FLAG: --register-node="true" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996831 2579 flags.go:64] FLAG: --register-with-taints="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996834 2579 flags.go:64] FLAG: --registry-burst="10" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996837 2579 flags.go:64] FLAG: --registry-qps="5" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996840 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996843 2579 flags.go:64] FLAG: --reserved-memory="" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996846 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996849 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 18:12:18.004212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996852 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996855 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996858 2579 flags.go:64] FLAG: --runonce="false" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996860 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996863 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996866 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996869 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996872 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996874 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996878 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996881 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996899 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996902 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996905 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996909 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996912 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996915 2579 flags.go:64] FLAG: --system-cgroups="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996918 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996923 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996926 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996928 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996934 2579 flags.go:64] FLAG: --tls-min-version="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996936 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996939 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996942 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 18:12:18.004865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996945 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996948 2579 flags.go:64] FLAG: --v="2" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996951 2579 flags.go:64] FLAG: --version="false" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996955 2579 flags.go:64] FLAG: --vmodule="" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996958 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.996962 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997067 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997071 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997074 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997077 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997080 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997082 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997085 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997088 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997090 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997093 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997096 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997098 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997100 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997105 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997109 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:18.005478 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997113 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997115 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997118 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997122 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997126 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997129 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997131 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997135 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997138 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997140 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997143 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997145 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997148 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997150 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997153 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997155 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997157 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997160 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997162 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:18.006001 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997165 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997168 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997170 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997173 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997175 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997177 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997180 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997182 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997184 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997187 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997189 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997192 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997194 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997197 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997199 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997202 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997205 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997208 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997210 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997213 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997217 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:18.006457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997219 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997222 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997224 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997226 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997229 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997232 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997234 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997236 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997239 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997241 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997244 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997247 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997249 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997251 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997254 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997258 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997261 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997263 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997266 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:18.007099 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997268 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997271 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997273 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997276 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997278 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997280 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997283 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997286 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997288 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997290 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997293 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997296 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997300 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997302 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997304 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997307 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997309 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997312 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997314 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:18.007601 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997316 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997319 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997321 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997324 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997326 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:17.997329 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:17.997334 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.004449 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.004464 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.005158 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.005165 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005222 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005229 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005234 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:18.008224 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005237 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005240 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005242 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005245 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005248 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005250 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005253 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005256 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005259 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005262 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005265 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005267 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005270 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005272 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005275 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005278 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005280 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005283 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005285 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:18.008588 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005288 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005291 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005293 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005296 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005298 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005300 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005303 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005306 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005309 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005311 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005314 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005317 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005319 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005322 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005324 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005327 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005329 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005332 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005334 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005337 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:18.009071 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005340 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005342 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005345 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005348 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005351 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005354 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005356 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005359 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005361 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005364 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005368 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005372 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005375 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005378 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005381 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005384 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005386 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005389 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005391 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005394 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:18.009590 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005397 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005399 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005402 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005404 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005407 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005410 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005412 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005415 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005417 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005420 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005422 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005425 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005427 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005430 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005432 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005435 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005438 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005441 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005443 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005446 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:18.010106 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005448 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005451 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005453 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005456 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005458 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005461 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005463 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005466 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005468 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005471 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005474 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005477 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005479 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005482 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005486 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005490 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:18.010587 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005493 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.005498 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005607 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005612 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005615 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005618 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005621 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005624 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005626 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005629 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005632 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005635 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005638 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005641 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005644 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 18:12:18.011098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005646 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005649 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005652 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005654 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005656 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005659 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005661 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005664 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005667 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005669 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005671 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005674 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005677 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005680 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005682 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005685 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005687 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005690 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005692 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005695 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 18:12:18.011457 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005697 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005700 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005702 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005705 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005707 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005709 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005712 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005714 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005716 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005719 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005721 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005724 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005727 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005730 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005733 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005736 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005739 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005741 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005744 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005746 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 18:12:18.011949 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005748 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005751 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005753 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005756 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005758 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005761 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005763 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005766 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005768 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005771 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005773 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005776 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005778 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005781 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005783 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005785 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005788 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005790 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005792 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 18:12:18.012419 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005796 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005799 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005802 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005805 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005808 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005811 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005813 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005816 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005818 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005821 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005823 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005826 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005829 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005831 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005834 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005836 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005839 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005841 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005844 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 18:12:18.012873 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005847 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005850 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005853 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005856 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005859 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005862 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005864 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:18.005866 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.005871 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.005976 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.010587 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.011623 2579 server.go:1019] "Starting client certificate rotation" Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.011724 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:12:18.013344 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.011758 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 18:12:18.013970 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.013957 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:12:18.015477 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.015464 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 18:12:18.025253 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.025236 2579 log.go:25] "Validated CRI v1 runtime API" Sep 17 18:12:18.026747 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.026732 2579 log.go:25] "Validated CRI v1 image API" Sep 17 18:12:18.027634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.027622 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 18:12:18.030910 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.030869 2579 fs.go:135] Filesystem UUIDs: map[5591dd8e-85da-4441-a799-49dd206f28e1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f28a348f-c90a-4906-a153-de3e0dfe3675:/dev/nvme0n1p4] Sep 17 18:12:18.030959 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.030910 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 18:12:18.035714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.035614 2579 manager.go:216] Machine: {Timestamp:2026-09-17 18:12:18.034454756 +0000 UTC m=+0.334577707 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094971 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2353c6123f8a610680fca8dc486a SystemUUID:ec2e2353-c612-3f8a-6106-80fca8dc486a BootID:4acf3023-6a99-46e6-9849-2c6a1485f656 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e4:8b:66:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e4:8b:66:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:65:c8:39:36:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 18:12:18.035714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.035713 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 18:12:18.035806 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.035787 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 18:12:18.036842 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.036817 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 18:12:18.036983 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.036844 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 18:12:18.037764 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.037753 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 18:12:18.037799 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.037765 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 18:12:18.037799 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.037777 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:12:18.038411 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.038398 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 18:12:18.038483 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.038474 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 18:12:18.040505 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.040490 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:12:18.041305 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041293 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:12:18.041419 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041410 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 18:12:18.041448 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041440 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 17 18:12:18.041475 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041453 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 18:12:18.041475 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041468 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 18:12:18.041540 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041476 2579 kubelet.go:398] "Adding apiserver pod source" Sep 17 18:12:18.041540 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041486 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 18:12:18.041831 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041818 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:12:18.041912 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.041842 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 18:12:18.045199 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.044808 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 18:12:18.047044 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.047030 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 18:12:18.047108 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.047060 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 18:12:18.048547 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048535 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048552 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048558 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048563 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048572 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048577 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048589 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048595 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048601 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048606 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048614 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 18:12:18.048612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.048619 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 18:12:18.049419 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.049409 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 18:12:18.049419 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.049418 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 18:12:18.052535 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.052516 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 18:12:18.052668 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.052577 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 18:12:18.052711 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.052679 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 18:12:18.052948 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.052937 2579 server.go:1268] "Started kubelet" Sep 17 18:12:18.053028 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.052999 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 18:12:18.053090 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.053030 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 18:12:18.053144 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.053095 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 18:12:18.053802 ip-10-0-137-166 systemd[1]: Started Kubernetes Kubelet. Sep 17 18:12:18.054330 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.054310 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 18:12:18.054924 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.054909 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 17 18:12:18.057809 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.057787 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 18:12:18.058568 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.057639 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-166.ec2.internal.18d62e3c3543f5b4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-166.ec2.internal,UID:ip-10-0-137-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-166.ec2.internal,},FirstTimestamp:2026-09-17 18:12:18.052912564 +0000 UTC m=+0.353035513,LastTimestamp:2026-09-17 18:12:18.052912564 +0000 UTC m=+0.353035513,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-166.ec2.internal,}" Sep 17 18:12:18.060458 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.060443 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 18:12:18.060537 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.060458 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 18:12:18.060754 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.060533 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.061113 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061095 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 18:12:18.061185 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061110 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 18:12:18.061185 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061128 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 18:12:18.061299 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061214 2579 factory.go:55] Registering systemd factory Sep 17 18:12:18.061299 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061228 2579 factory.go:223] Registration of the systemd container factory successfully Sep 17 18:12:18.061299 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061233 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 17 18:12:18.061299 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061243 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 17 18:12:18.061470 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061455 2579 factory.go:153] Registering CRI-O factory Sep 17 18:12:18.061470 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061471 2579 factory.go:223] Registration of the crio container factory successfully Sep 17 18:12:18.061634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061519 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 18:12:18.061634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061537 2579 factory.go:103] Registering Raw factory Sep 17 18:12:18.061634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061551 2579 manager.go:1196] Started watching for new ooms in manager Sep 17 18:12:18.061937 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.061922 2579 manager.go:349] Starting recovery of all containers Sep 17 18:12:18.063311 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.063138 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 18:12:18.063311 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.063206 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 18:12:18.075191 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.075171 2579 manager.go:354] Recovery completed Sep 17 18:12:18.079918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.079906 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.083611 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.083593 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.083689 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.083627 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.083689 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.083642 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.084237 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.084224 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 18:12:18.084237 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.084235 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 18:12:18.084328 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.084248 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 17 18:12:18.084328 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.084256 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.085281 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085266 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.085324 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085295 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.085324 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085308 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.085470 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085451 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxrnb" Sep 17 18:12:18.085816 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085806 2579 policy_none.go:49] "None policy: Start" Sep 17 18:12:18.085849 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085822 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 18:12:18.085849 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.085831 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 18:12:18.086797 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.086788 2579 policy_none.go:47] "Start" Sep 17 18:12:18.092697 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.092681 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zxrnb" Sep 17 18:12:18.093899 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.093823 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-166.ec2.internal.18d62e3c3718602c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-166.ec2.internal,UID:ip-10-0-137-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-166.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-166.ec2.internal,},FirstTimestamp:2026-09-17 18:12:18.083610668 +0000 UTC m=+0.383733619,LastTimestamp:2026-09-17 18:12:18.083610668 +0000 UTC m=+0.383733619,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-166.ec2.internal,}" Sep 17 18:12:18.096879 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.096821 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-166.ec2.internal.18d62e3c3718bd1c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-166.ec2.internal,UID:ip-10-0-137-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-166.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-166.ec2.internal,},FirstTimestamp:2026-09-17 18:12:18.08363446 +0000 UTC m=+0.383757417,LastTimestamp:2026-09-17 18:12:18.08363446 +0000 UTC m=+0.383757417,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-166.ec2.internal,}" Sep 17 18:12:18.128470 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.128454 2579 manager.go:337] "Starting Device Plugin manager" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.128510 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.128520 2579 server.go:87] "Starting device plugin registration server" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.128827 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.128837 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.128970 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.129053 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.129060 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.129489 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 18:12:18.138561 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.129542 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.200734 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.200709 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 18:12:18.202028 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.202003 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 18:12:18.202119 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.202055 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 18:12:18.202119 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.202076 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 18:12:18.202197 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.202114 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 18:12:18.204394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.204376 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:18.229735 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.229713 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.230626 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.230597 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.230626 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.230625 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.230750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.230634 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.230750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.230657 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.240545 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.240486 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.240545 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.240508 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-166.ec2.internal\": node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.260086 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.260068 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.302391 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.302357 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal"] Sep 17 18:12:18.302447 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.302434 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.303327 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.303310 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.303374 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.303340 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.303374 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.303349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.305552 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.305540 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.305675 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.305652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.305716 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.305680 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.306323 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306307 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.306400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306323 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.306400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306339 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.306400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306344 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.306400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306352 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.306400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.306356 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.308588 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.308572 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.308638 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.308605 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:18.309729 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.309709 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:18.309808 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.309739 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:18.309808 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.309752 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:18.332543 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.332523 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-166.ec2.internal\" not found" node="ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.337326 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.337312 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-166.ec2.internal\" not found" node="ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.361086 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.361062 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.362287 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.362272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3f900471a2071921a644d61a817625b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"b3f900471a2071921a644d61a817625b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.362345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.362294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.362345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.362310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.461720 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.461692 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.462806 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.462852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.462852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3f900471a2071921a644d61a817625b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"b3f900471a2071921a644d61a817625b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.462944 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462869 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3f900471a2071921a644d61a817625b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-166.ec2.internal\" (UID: \"b3f900471a2071921a644d61a817625b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.462944 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.462944 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.462906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ab1e3c3a324bf78c195162f29e4f62c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal\" (UID: \"1ab1e3c3a324bf78c195162f29e4f62c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.562393 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.562324 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.636593 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.636571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.642203 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.641943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:18.662506 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.662482 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.762970 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.762940 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.863344 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.863320 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:18.889056 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:18.889030 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:18.964431 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:18.964403 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:19.011647 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.011622 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 18:12:19.012063 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.011782 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:12:19.012063 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.011782 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 18:12:19.064696 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:19.064672 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:19.076059 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.076041 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:19.096552 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.096525 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 18:07:19 +0000 UTC" deadline="2028-06-27 17:20:47.952825808 +0000 UTC" Sep 17 18:12:19.096639 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.096552 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15575h8m28.856276824s" Sep 17 18:12:19.165669 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:19.165607 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:19.224541 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:19.224498 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f900471a2071921a644d61a817625b.slice/crio-b4dc393ab4cc211f343ac8cf8a063c28931fe53d674dfaeaf50fdd1feb2353c1 WatchSource:0}: Error finding container b4dc393ab4cc211f343ac8cf8a063c28931fe53d674dfaeaf50fdd1feb2353c1: Status 404 returned error can't find the container with id b4dc393ab4cc211f343ac8cf8a063c28931fe53d674dfaeaf50fdd1feb2353c1 Sep 17 18:12:19.229170 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.229147 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 18:12:19.231859 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.231842 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 18:12:19.232721 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.232705 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientMemory" Sep 17 18:12:19.232780 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.232734 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 18:12:19.232780 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.232746 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeHasSufficientPID" Sep 17 18:12:19.266467 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:19.266445 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-166.ec2.internal\" not found" Sep 17 18:12:19.282046 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.282027 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:19.360615 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.360592 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" Sep 17 18:12:19.372192 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.372172 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 18:12:19.373220 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.373208 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" Sep 17 18:12:19.383395 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:19.383374 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 18:12:21.211644 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.211611 2579 apiserver.go:52] "Watching apiserver" Sep 17 18:12:21.219536 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.219510 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 18:12:21.219926 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.219905 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal","openshift-multus/network-metrics-daemon-gth8h","openshift-network-diagnostics/network-check-target-4w6hg","openshift-network-operator/iptables-alerter-brfk6","openshift-ovn-kubernetes/ovnkube-node-5nn7p","kube-system/global-pull-secret-syncer-clwkx","kube-system/konnectivity-agent-2d7wq","kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-62n2b","openshift-dns/node-resolver-jnvbj","openshift-image-registry/node-ca-c2fpd","openshift-multus/multus-additional-cni-plugins-qmdf2","openshift-multus/multus-pm2pg"] Sep 17 18:12:21.222783 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.222388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.222783 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.222466 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:21.224667 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.224642 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.226714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.226689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 18:12:21.227250 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.227230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.227425 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.227408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 18:12:21.227611 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.227596 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.227839 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.227825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hcsz\"" Sep 17 18:12:21.228098 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.228083 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 18:12:21.228447 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.228431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.228520 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.228500 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:21.229313 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.229292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:21.229409 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.229355 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:21.229409 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.229398 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 18:12:21.231484 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.231466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.233599 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.233577 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.233838 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.233819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.233838 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.233830 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 18:12:21.234116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.234009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.234252 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.234234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-98p6x\"" Sep 17 18:12:21.236198 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236181 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.236785 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236610 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 18:12:21.236785 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 18:12:21.236785 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236674 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-thwll\"" Sep 17 18:12:21.236785 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236715 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 18:12:21.236785 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236720 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 18:12:21.237159 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.237159 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.236891 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.238339 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.238320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.239660 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240626 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f98r9\"" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq7gj\" (UniqueName: \"kubernetes.io/projected/3ac0164e-4f31-409d-8aba-677ee5757d43-kube-api-access-tq7gj\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-kubelet-config\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240815 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74rhw\" (UniqueName: \"kubernetes.io/projected/76e2edb4-629e-4837-acfd-633370c1a1f3-kube-api-access-74rhw\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-cnibin\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac0164e-4f31-409d-8aba-677ee5757d43-iptables-alerter-script\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac0164e-4f31-409d-8aba-677ee5757d43-host-slash\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.240972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-system-cni-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-dbus\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.241867 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241213 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmcd5\" (UniqueName: \"kubernetes.io/projected/ac729035-33a8-4820-a49a-edd5e96875f6-kube-api-access-qmcd5\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nb9rd\"" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241712 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.241803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.243307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.242387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 18:12:21.244782 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.244760 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 18:12:21.245033 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.245015 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 18:12:21.245224 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.245206 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5fpg7\"" Sep 17 18:12:21.245490 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.245469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.247824 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.247802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.247927 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.247900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5vt5l\"" Sep 17 18:12:21.247927 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.247912 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.248030 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.247970 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.250178 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.250160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.250962 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.250944 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 18:12:21.251264 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.251235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.251611 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.251594 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.251858 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.251842 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t78j4\"" Sep 17 18:12:21.254297 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.254143 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 18:12:21.254438 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.254350 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 18:12:21.254497 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.254351 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 18:12:21.254750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.254351 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-75jgp\"" Sep 17 18:12:21.275778 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.275757 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2w2m9" Sep 17 18:12:21.285834 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.285814 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2w2m9" Sep 17 18:12:21.330503 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.330472 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 18:12:21.341725 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-kubelet-config\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.341814 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-daemon-config\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.341814 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341750 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/325e253d-faeb-432d-acec-d719f96ddd02-konnectivity-ca\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.341814 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.341814 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysconfig\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-systemd\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-sys\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-kubelet-config\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341874 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-systemd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.341936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-conf-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/325e253d-faeb-432d-acec-d719f96ddd02-agent-certs\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.341984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342016 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-lib-modules\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-multus\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.342100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.342122 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.342211 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:21.842173575 +0000 UTC m=+2.973644076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342229 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-kubernetes\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-etc-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-node-log\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4r7f\" (UniqueName: \"kubernetes.io/projected/41f9e773-950c-44fe-a1d5-fdd69d9de507-kube-api-access-z4r7f\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342352 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342360 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-tuned\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-ovn\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f40bddb-54de-4f40-bf34-1b232eddd4e4-host\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342468 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k6zt\" (UniqueName: \"kubernetes.io/projected/12d2b3ce-8fe2-4f45-b467-988972662ec0-kube-api-access-2k6zt\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-systemd-units\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342515 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-netd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.342529 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342536 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-netns\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-var-lib-kubelet\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.342597 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:21.842581024 +0000 UTC m=+2.974051511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.342703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-log-socket\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f40bddb-54de-4f40-bf34-1b232eddd4e4-serviceca\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac0164e-4f31-409d-8aba-677ee5757d43-host-slash\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-bin\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-system-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ac0164e-4f31-409d-8aba-677ee5757d43-host-slash\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-multus-certs\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-system-cni-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-conf\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-tmp\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8674d\" (UniqueName: \"kubernetes.io/projected/7b548676-bb64-40f1-af2b-8c2c84d15ab4-kube-api-access-8674d\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342937 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-system-cni-dir\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-config\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.342978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f136a54-692c-4341-9ab7-842badca08d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-hostroot\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.343246 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmcd5\" (UniqueName: \"kubernetes.io/projected/ac729035-33a8-4820-a49a-edd5e96875f6-kube-api-access-qmcd5\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq7gj\" (UniqueName: \"kubernetes.io/projected/3ac0164e-4f31-409d-8aba-677ee5757d43-kube-api-access-tq7gj\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-modprobe-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b548676-bb64-40f1-af2b-8c2c84d15ab4-tmp-dir\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwglh\" (UniqueName: \"kubernetes.io/projected/0f136a54-692c-4341-9ab7-842badca08d8-kube-api-access-kwglh\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-cnibin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-cni-binary-copy\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-kubelet\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74rhw\" (UniqueName: \"kubernetes.io/projected/76e2edb4-629e-4837-acfd-633370c1a1f3-kube-api-access-74rhw\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-run\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-script-lib\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-k8s-cni-cncf-io\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvn2d\" (UniqueName: \"kubernetes.io/projected/0f40bddb-54de-4f40-bf34-1b232eddd4e4-kube-api-access-hvn2d\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-cnibin\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.344078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac0164e-4f31-409d-8aba-677ee5757d43-iptables-alerter-script\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-env-overrides\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-device-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343757 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvhm\" (UniqueName: \"kubernetes.io/projected/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kube-api-access-zpvhm\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-kubelet\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e2edb4-629e-4837-acfd-633370c1a1f3-cnibin\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-slash\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-netns\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-var-lib-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-socket-dir-parent\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-dbus\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-host\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b548676-bb64-40f1-af2b-8c2c84d15ab4-hosts-file\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-bin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.344648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-etc-kubernetes\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.345131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.343967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e2edb4-629e-4837-acfd-633370c1a1f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.345131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.344057 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/153d2612-ba28-4f30-9aec-64e7d3afc04d-dbus\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.345131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.344187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ac0164e-4f31-409d-8aba-677ee5757d43-iptables-alerter-script\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.354921 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.354901 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:21.355022 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.354931 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:21.355022 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.354959 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:21.355022 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.355009 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:21.85499525 +0000 UTC m=+2.986465760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:21.355415 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.355398 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 18:12:21.361418 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.359657 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74rhw\" (UniqueName: \"kubernetes.io/projected/76e2edb4-629e-4837-acfd-633370c1a1f3-kube-api-access-74rhw\") pod \"multus-additional-cni-plugins-qmdf2\" (UID: \"76e2edb4-629e-4837-acfd-633370c1a1f3\") " pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.361418 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.359662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq7gj\" (UniqueName: \"kubernetes.io/projected/3ac0164e-4f31-409d-8aba-677ee5757d43-kube-api-access-tq7gj\") pod \"iptables-alerter-brfk6\" (UID: \"3ac0164e-4f31-409d-8aba-677ee5757d43\") " pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.361418 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.359679 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmcd5\" (UniqueName: \"kubernetes.io/projected/ac729035-33a8-4820-a49a-edd5e96875f6-kube-api-access-qmcd5\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.375827 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.375780 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"1ab1e3c3a324bf78c195162f29e4f62c","Type":"ContainerStarted","Data":"ec5ae8a2c43232e5a72957b9641f9cca77783b7aaf34843a0692dd5d27dcf8d8"} Sep 17 18:12:21.377273 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.377255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" event={"ID":"b3f900471a2071921a644d61a817625b","Type":"ContainerStarted","Data":"b4dc393ab4cc211f343ac8cf8a063c28931fe53d674dfaeaf50fdd1feb2353c1"} Sep 17 18:12:21.444699 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-host\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.444699 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b548676-bb64-40f1-af2b-8c2c84d15ab4-hosts-file\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-bin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-etc-kubernetes\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-daemon-config\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-host\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/325e253d-faeb-432d-acec-d719f96ddd02-konnectivity-ca\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysconfig\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-systemd\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-sys\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-systemd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.444932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444918 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-conf-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.444967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/325e253d-faeb-432d-acec-d719f96ddd02-agent-certs\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-lib-modules\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-multus\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-kubernetes\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-etc-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-node-log\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4r7f\" (UniqueName: \"kubernetes.io/projected/41f9e773-950c-44fe-a1d5-fdd69d9de507-kube-api-access-z4r7f\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-tuned\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-ovn\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f40bddb-54de-4f40-bf34-1b232eddd4e4-host\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/325e253d-faeb-432d-acec-d719f96ddd02-konnectivity-ca\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k6zt\" (UniqueName: \"kubernetes.io/projected/12d2b3ce-8fe2-4f45-b467-988972662ec0-kube-api-access-2k6zt\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-systemd-units\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.445358 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-netd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b548676-bb64-40f1-af2b-8c2c84d15ab4-hosts-file\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-netns\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445409 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-bin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-var-lib-kubelet\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-etc-kubernetes\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-log-socket\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445484 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445505 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f40bddb-54de-4f40-bf34-1b232eddd4e4-serviceca\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysconfig\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-bin\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-system-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-multus-certs\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-conf\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445663 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-tmp\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.446196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8674d\" (UniqueName: \"kubernetes.io/projected/7b548676-bb64-40f1-af2b-8c2c84d15ab4-kube-api-access-8674d\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-config\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f136a54-692c-4341-9ab7-842badca08d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-hostroot\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-modprobe-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445854 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b548676-bb64-40f1-af2b-8c2c84d15ab4-tmp-dir\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwglh\" (UniqueName: \"kubernetes.io/projected/0f136a54-692c-4341-9ab7-842badca08d8-kube-api-access-kwglh\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-cnibin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-cni-binary-copy\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-kubelet\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.445980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-run\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-script-lib\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-k8s-cni-cncf-io\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446104 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvn2d\" (UniqueName: \"kubernetes.io/projected/0f40bddb-54de-4f40-bf34-1b232eddd4e4-kube-api-access-hvn2d\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446130 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-daemon-config\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-env-overrides\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447051 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-log-socket\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-device-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvhm\" (UniqueName: \"kubernetes.io/projected/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kube-api-access-zpvhm\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-kubelet\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446286 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-slash\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-netns\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-var-lib-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-socket-dir-parent\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f40bddb-54de-4f40-bf34-1b232eddd4e4-serviceca\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-socket-dir-parent\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-multus-certs\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-systemd\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446674 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-sys\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446680 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-sysctl-conf\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446719 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.447855 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.446752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-conf-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-netd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-ovn\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f40bddb-54de-4f40-bf34-1b232eddd4e4-host\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-systemd-units\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-kubernetes\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447823 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-lib-modules\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447874 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-etc-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-var-lib-kubelet\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-netns\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-registration-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447946 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-cni-multus\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.447991 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-cni-bin\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-sys-fs\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-multus-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-system-cni-dir\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448202 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-run-k8s-cni-cncf-io\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.448430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-script-lib\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-modprobe-d\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448521 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-node-log\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-env-overrides\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448686 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-slash\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-socket-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448737 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b548676-bb64-40f1-af2b-8c2c84d15ab4-tmp-dir\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-device-dir\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-host-var-lib-kubelet\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d2b3ce-8fe2-4f45-b467-988972662ec0-run\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.448995 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-kubelet\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41f9e773-950c-44fe-a1d5-fdd69d9de507-cni-binary-copy\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-cnibin\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.449200 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41f9e773-950c-44fe-a1d5-fdd69d9de507-hostroot\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.449928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-var-lib-openvswitch\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449230 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f136a54-692c-4341-9ab7-842badca08d8-ovnkube-config\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-run-systemd\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449270 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f136a54-692c-4341-9ab7-842badca08d8-host-run-netns\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.449928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.449783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-tmp\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.451552 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.451515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f136a54-692c-4341-9ab7-842badca08d8-ovn-node-metrics-cert\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.452021 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.452000 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d2b3ce-8fe2-4f45-b467-988972662ec0-etc-tuned\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.457066 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.457047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/325e253d-faeb-432d-acec-d719f96ddd02-agent-certs\") pod \"konnectivity-agent-2d7wq\" (UID: \"325e253d-faeb-432d-acec-d719f96ddd02\") " pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.462886 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.462645 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8674d\" (UniqueName: \"kubernetes.io/projected/7b548676-bb64-40f1-af2b-8c2c84d15ab4-kube-api-access-8674d\") pod \"node-resolver-jnvbj\" (UID: \"7b548676-bb64-40f1-af2b-8c2c84d15ab4\") " pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.463334 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.463256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvn2d\" (UniqueName: \"kubernetes.io/projected/0f40bddb-54de-4f40-bf34-1b232eddd4e4-kube-api-access-hvn2d\") pod \"node-ca-c2fpd\" (UID: \"0f40bddb-54de-4f40-bf34-1b232eddd4e4\") " pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.463944 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.463925 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4r7f\" (UniqueName: \"kubernetes.io/projected/41f9e773-950c-44fe-a1d5-fdd69d9de507-kube-api-access-z4r7f\") pod \"multus-pm2pg\" (UID: \"41f9e773-950c-44fe-a1d5-fdd69d9de507\") " pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.464136 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.464115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwglh\" (UniqueName: \"kubernetes.io/projected/0f136a54-692c-4341-9ab7-842badca08d8-kube-api-access-kwglh\") pod \"ovnkube-node-5nn7p\" (UID: \"0f136a54-692c-4341-9ab7-842badca08d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.464906 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.464876 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k6zt\" (UniqueName: \"kubernetes.io/projected/12d2b3ce-8fe2-4f45-b467-988972662ec0-kube-api-access-2k6zt\") pod \"tuned-62n2b\" (UID: \"12d2b3ce-8fe2-4f45-b467-988972662ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.465252 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.465235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvhm\" (UniqueName: \"kubernetes.io/projected/ac37dc63-b27c-4e5a-bc63-e2f9504ce7de-kube-api-access-zpvhm\") pod \"aws-ebs-csi-driver-node-ss4z7\" (UID: \"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.538436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.538395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" Sep 17 18:12:21.551564 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.551398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-brfk6" Sep 17 18:12:21.558119 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.558098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:21.563792 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.563772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pm2pg" Sep 17 18:12:21.571416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.571395 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" Sep 17 18:12:21.579897 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.579878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:21.587617 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.587601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62n2b" Sep 17 18:12:21.595191 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.595175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnvbj" Sep 17 18:12:21.595903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.595885 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:21.601782 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.601766 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2fpd" Sep 17 18:12:21.819524 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.819495 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 18:12:21.849443 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.849410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:21.849625 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.849467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:21.849625 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.849595 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:21.849731 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.849669 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:22.84965094 +0000 UTC m=+3.981121443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:21.849731 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.849595 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:21.849814 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.849742 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:22.849726305 +0000 UTC m=+3.981196803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:21.949754 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:21.949719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:21.949904 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.949876 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:21.949904 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.949900 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:21.949984 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.949910 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:21.949984 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:21.949960 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:22.949947714 +0000 UTC m=+4.081418211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:22.289101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.289056 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:07:21 +0000 UTC" deadline="2028-06-28 01:18:40.759821128 +0000 UTC" Sep 17 18:12:22.289101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.289091 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15583h6m18.470733686s" Sep 17 18:12:22.371634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.371611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:22.371767 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.371702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:22.432685 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:22.432655 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b548676_bb64_40f1_af2b_8c2c84d15ab4.slice/crio-a5bcf1844e3e97872b4c7a6146036597ef4f3d353cb003d3a05f37ed3d047b1e WatchSource:0}: Error finding container a5bcf1844e3e97872b4c7a6146036597ef4f3d353cb003d3a05f37ed3d047b1e: Status 404 returned error can't find the container with id a5bcf1844e3e97872b4c7a6146036597ef4f3d353cb003d3a05f37ed3d047b1e Sep 17 18:12:22.435068 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:22.435046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac0164e_4f31_409d_8aba_677ee5757d43.slice/crio-239a73e5c58e40c386bb646710c3d8b8c5cf1045204c0dc7cbdc2cdd051499fa WatchSource:0}: Error finding container 239a73e5c58e40c386bb646710c3d8b8c5cf1045204c0dc7cbdc2cdd051499fa: Status 404 returned error can't find the container with id 239a73e5c58e40c386bb646710c3d8b8c5cf1045204c0dc7cbdc2cdd051499fa Sep 17 18:12:22.436220 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:22.436195 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325e253d_faeb_432d_acec_d719f96ddd02.slice/crio-632175cb0e3ef4fff658e96bb9727ff72ed8cd414e36d544eafeebed6988d204 WatchSource:0}: Error finding container 632175cb0e3ef4fff658e96bb9727ff72ed8cd414e36d544eafeebed6988d204: Status 404 returned error can't find the container with id 632175cb0e3ef4fff658e96bb9727ff72ed8cd414e36d544eafeebed6988d204 Sep 17 18:12:22.857065 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.856991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:22.857065 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.857040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:22.857219 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.857130 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:22.857219 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.857132 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:22.857219 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.857180 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:24.857167263 +0000 UTC m=+5.988637745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:22.857219 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.857192 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:24.857186777 +0000 UTC m=+5.988657259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:22.958040 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:22.957515 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:22.958040 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.957682 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:22.958040 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.957707 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:22.958040 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.957720 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:22.958040 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:22.957769 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:24.957757224 +0000 UTC m=+6.089227707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:23.289581 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.289503 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 18:07:21 +0000 UTC" deadline="2028-05-06 23:34:30.323141316 +0000 UTC" Sep 17 18:12:23.289581 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.289578 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14333h22m7.033568067s" Sep 17 18:12:23.373922 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.373890 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:23.374098 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:23.374016 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:23.374428 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.374405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:23.374613 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:23.374523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:23.387322 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.387283 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ab1e3c3a324bf78c195162f29e4f62c" containerID="7db5b8000fef443c9096f89d2d849720d497497cccbf43ecd66fa980af4174fc" exitCode=0 Sep 17 18:12:23.387449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.387362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"1ab1e3c3a324bf78c195162f29e4f62c","Type":"ContainerDied","Data":"7db5b8000fef443c9096f89d2d849720d497497cccbf43ecd66fa980af4174fc"} Sep 17 18:12:23.394288 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.394262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pm2pg" event={"ID":"41f9e773-950c-44fe-a1d5-fdd69d9de507","Type":"ContainerStarted","Data":"479e40431e8178e4793bf8e777e1d72732fd52c801c0a7817e019670bca28601"} Sep 17 18:12:23.398245 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.398106 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"915108e7475405f9d4536acfc1a0983a960cf2275669e5b225e52917490f84e8"} Sep 17 18:12:23.414468 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.414439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62n2b" event={"ID":"12d2b3ce-8fe2-4f45-b467-988972662ec0","Type":"ContainerStarted","Data":"0ff776869f40294a86c8432b934cfdf2a9fb75aa49cb155f24b5e9c563690fc5"} Sep 17 18:12:23.417990 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.417938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d7wq" event={"ID":"325e253d-faeb-432d-acec-d719f96ddd02","Type":"ContainerStarted","Data":"632175cb0e3ef4fff658e96bb9727ff72ed8cd414e36d544eafeebed6988d204"} Sep 17 18:12:23.425754 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.425726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-brfk6" event={"ID":"3ac0164e-4f31-409d-8aba-677ee5757d43","Type":"ContainerStarted","Data":"239a73e5c58e40c386bb646710c3d8b8c5cf1045204c0dc7cbdc2cdd051499fa"} Sep 17 18:12:23.436101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.436075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" event={"ID":"b3f900471a2071921a644d61a817625b","Type":"ContainerStarted","Data":"48452112e17436716d967f04e4c686715963577107a978096841c1f4d0e89080"} Sep 17 18:12:23.461934 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.461904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2fpd" event={"ID":"0f40bddb-54de-4f40-bf34-1b232eddd4e4","Type":"ContainerStarted","Data":"34094c0aa51c3627dd75125680c0b49c81f44a2cf036c6f59a62ce17579f2d37"} Sep 17 18:12:23.489038 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.489006 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" event={"ID":"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de","Type":"ContainerStarted","Data":"36c194a4a556f190108dc80b20210a1160ad44df9e52922d88ae00f77ccd3314"} Sep 17 18:12:23.507795 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.507756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerStarted","Data":"efacb73e2d2b6b1af9b06e3799dc8f5a1c65428d33a6b3eb63c4bbf67195da5f"} Sep 17 18:12:23.518617 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:23.518582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnvbj" event={"ID":"7b548676-bb64-40f1-af2b-8c2c84d15ab4","Type":"ContainerStarted","Data":"a5bcf1844e3e97872b4c7a6146036597ef4f3d353cb003d3a05f37ed3d047b1e"} Sep 17 18:12:24.371289 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.371255 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:24.371861 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.371438 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:24.545229 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.545194 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" event={"ID":"1ab1e3c3a324bf78c195162f29e4f62c","Type":"ContainerStarted","Data":"ad59be11ee6f23ce3530ccd97493adab9a9d2cbdf393ac4196d1fe95469fa200"} Sep 17 18:12:24.565252 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.564861 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-166.ec2.internal" podStartSLOduration=4.564842362 podStartE2EDuration="4.564842362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:23.455811856 +0000 UTC m=+4.587282361" watchObservedRunningTime="2026-09-17 18:12:24.564842362 +0000 UTC m=+5.696312868" Sep 17 18:12:24.569590 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.565441 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-166.ec2.internal" podStartSLOduration=4.565430389 podStartE2EDuration="4.565430389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:24.564493248 +0000 UTC m=+5.695963756" watchObservedRunningTime="2026-09-17 18:12:24.565430389 +0000 UTC m=+5.696900896" Sep 17 18:12:24.875421 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.875377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:24.875622 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.875446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:24.875622 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.875595 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:24.875756 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.875660 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:28.875640911 +0000 UTC m=+10.007111411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:24.875756 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.875728 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:24.875866 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.875766 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:28.875754584 +0000 UTC m=+10.007225083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:24.976668 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:24.976605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:24.976858 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.976833 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:24.976858 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.976858 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:24.977003 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.976871 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:24.977003 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:24.976931 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:28.976911869 +0000 UTC m=+10.108382369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:25.373769 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:25.371454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:25.373769 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:25.371614 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:25.373769 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:25.372077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:25.373769 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:25.372172 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:26.370932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:26.370898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:26.371116 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:26.370996 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:27.374910 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:27.374874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:27.375281 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:27.374991 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:27.375281 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:27.375056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:27.375281 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:27.375141 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:28.371800 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:28.371274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:28.371800 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:28.371416 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:28.911456 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:28.911426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:28.911976 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:28.911477 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:28.911976 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:28.911611 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:28.911976 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:28.911612 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:28.911976 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:28.911676 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:36.911658289 +0000 UTC m=+18.043128789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:28.911976 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:28.911695 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:36.911686765 +0000 UTC m=+18.043157251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:29.012550 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:29.012512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:29.012714 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.012698 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:29.012768 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.012723 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:29.012768 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.012738 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:29.012845 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.012795 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:37.012776883 +0000 UTC m=+18.144247382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:29.373342 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:29.372311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:29.373342 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.372446 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:29.373342 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:29.372480 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:29.373342 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:29.372627 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:30.371261 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:30.371228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:30.371797 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:30.371334 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:31.374109 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:31.374074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:31.374584 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:31.374208 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:31.374668 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:31.374587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:31.374717 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:31.374682 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:32.371572 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:32.371528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:32.371743 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:32.371669 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:33.371445 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:33.371405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:33.371921 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:33.371567 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:33.371921 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:33.371581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:33.371921 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:33.371697 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:34.371516 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:34.371482 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:34.371950 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:34.371621 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:35.371158 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:35.371121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:35.371326 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:35.371260 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:35.371770 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:35.371736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:35.372169 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:35.371851 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:36.371137 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:36.371099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:36.371359 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:36.371233 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:36.976655 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:36.976615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:36.977121 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:36.976689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:36.977121 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:36.976756 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:36.977121 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:36.976778 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:36.977121 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:36.976829 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:12:52.976809034 +0000 UTC m=+34.108279534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:36.977121 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:36.977124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:52.977111565 +0000 UTC m=+34.108582047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:37.078254 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:37.078208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:37.078428 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.078389 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:37.078428 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.078418 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:37.078531 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.078431 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:37.078615 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.078571 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:12:53.078515184 +0000 UTC m=+34.209985668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:37.371280 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:37.371243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:37.371459 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:37.371244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:37.371459 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.371372 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:37.371459 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:37.371415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:38.371823 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:38.371399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:38.371823 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:38.371504 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:39.371679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:39.371645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:39.371860 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:39.371743 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:39.372195 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:39.372103 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:39.372195 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:39.372180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:40.373429 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.372682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:40.373429 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:40.372812 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:40.587531 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.587311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" event={"ID":"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de","Type":"ContainerStarted","Data":"71dc99545d9fd86bda80d83c0231fe32e17b7e764f377f1233f3c9e7069d34aa"} Sep 17 18:12:40.589252 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.589225 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="d85dce66869d4d8f0765c3aec9eadd04a791cd510709cb7bcfb69d183bbc6145" exitCode=0 Sep 17 18:12:40.589357 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.589306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"d85dce66869d4d8f0765c3aec9eadd04a791cd510709cb7bcfb69d183bbc6145"} Sep 17 18:12:40.591081 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.591058 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnvbj" event={"ID":"7b548676-bb64-40f1-af2b-8c2c84d15ab4","Type":"ContainerStarted","Data":"4291f250a81aa691fb5db1e0195c1cc1a55288fe373847b69fd4d585cc67db4a"} Sep 17 18:12:40.592655 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.592637 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pm2pg" event={"ID":"41f9e773-950c-44fe-a1d5-fdd69d9de507","Type":"ContainerStarted","Data":"c311fae00aa14ce4fb08f3e58798699631454715d994d524905819e77f794dd2"} Sep 17 18:12:40.594784 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.594757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"a49454a49a5b3cde29c6d91ad81453a96cc023b7a7bb1c2d1b48d490ccc142d7"} Sep 17 18:12:40.594901 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.594884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"8ebf1fa287222a10308960514e97d0a999a28bf154fba5be7ed529cc740d6a0e"} Sep 17 18:12:40.596316 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.596224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62n2b" event={"ID":"12d2b3ce-8fe2-4f45-b467-988972662ec0","Type":"ContainerStarted","Data":"5165734217f604f6cb037a458a532073db9eff171aeacf5ebeb75e4662eee6f3"} Sep 17 18:12:40.598078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.598051 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d7wq" event={"ID":"325e253d-faeb-432d-acec-d719f96ddd02","Type":"ContainerStarted","Data":"00265a23dd6773490909c0b8536e7bb03947f68e47453845a20e3a30df3071b5"} Sep 17 18:12:40.599666 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.599643 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2fpd" event={"ID":"0f40bddb-54de-4f40-bf34-1b232eddd4e4","Type":"ContainerStarted","Data":"3eec8f4ee1704c2edbbb25f320f990d223624a613dde8aa25436543bb8c96c7e"} Sep 17 18:12:40.629286 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.629226 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2d7wq" podStartSLOduration=10.975052679000001 podStartE2EDuration="21.629210222s" totalImagesPullingTime="10.654157543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:40.628878569 +0000 UTC m=+21.760349074" watchObservedRunningTime="2026-09-17 18:12:40.629210222 +0000 UTC m=+21.760680726" Sep 17 18:12:40.672852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.672812 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-62n2b" podStartSLOduration=3.847515581 podStartE2EDuration="21.672798179s" totalImagesPullingTime="17.825282598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:40.646966111 +0000 UTC m=+21.778436618" watchObservedRunningTime="2026-09-17 18:12:40.672798179 +0000 UTC m=+21.804268683" Sep 17 18:12:40.693531 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.693473 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pm2pg" podStartSLOduration=3.816094324 podStartE2EDuration="21.693456027s" totalImagesPullingTime="17.877361703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:40.672391916 +0000 UTC m=+21.803862422" watchObservedRunningTime="2026-09-17 18:12:40.693456027 +0000 UTC m=+21.824926533" Sep 17 18:12:40.717872 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.717714 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jnvbj" podStartSLOduration=3.886887968 podStartE2EDuration="21.717699439s" totalImagesPullingTime="17.830811471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:40.693152893 +0000 UTC m=+21.824623401" watchObservedRunningTime="2026-09-17 18:12:40.717699439 +0000 UTC m=+21.849169922" Sep 17 18:12:40.862754 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.862730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:40.931508 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:40.931472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:41.373402 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.373373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:41.373571 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:41.373477 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:41.374306 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.373790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:41.374306 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:41.373852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:41.605556 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.605501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"e8a4677e85b0cf9c9a3d3d42a160412cb84b582221b1166e3fe7528f944283c4"} Sep 17 18:12:41.605739 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.605606 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"da5123841ef48335ec8e29a8718e3184f896e2687fbf7a8bca2c26911dffdfbd"} Sep 17 18:12:41.605739 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.605661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"ae2bfd2b960afc63effbc98ef593869c954c59d508e2464e8ec4270e7be59277"} Sep 17 18:12:41.605739 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.605711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"497b9410c52fd17c864c529799a5912acbe5d587110f007f5d2536841fb36f1d"} Sep 17 18:12:41.607037 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.607009 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-brfk6" event={"ID":"3ac0164e-4f31-409d-8aba-677ee5757d43","Type":"ContainerStarted","Data":"11e2acb63bb1b82b6e1bfcadf38924adb3e3720b9581f0ee2cf844477967d5a7"} Sep 17 18:12:41.623870 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.623797 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-brfk6" podStartSLOduration=4.794517606 podStartE2EDuration="22.62377986s" totalImagesPullingTime="17.829262254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:41.623763104 +0000 UTC m=+22.755233610" watchObservedRunningTime="2026-09-17 18:12:41.62377986 +0000 UTC m=+22.755250368" Sep 17 18:12:41.624293 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.624261 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c2fpd" podStartSLOduration=4.809822503 podStartE2EDuration="22.624252511s" totalImagesPullingTime="17.814430008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:40.717946935 +0000 UTC m=+21.849417424" watchObservedRunningTime="2026-09-17 18:12:41.624252511 +0000 UTC m=+22.755723016" Sep 17 18:12:41.744323 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.744293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:41.844277 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.844254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:41.852283 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:41.852258 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 18:12:42.174735 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.174702 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:42.175288 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.175271 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:42.253270 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.253242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:42.311116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.311021 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T18:12:41.852278053Z","UUID":"00bb0443-1669-40e7-be8f-6ff515c68175","Handler":null,"Name":"","Endpoint":""} Sep 17 18:12:42.312339 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.312318 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 18:12:42.312460 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.312352 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 18:12:42.357274 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.357250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:42.371386 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.371359 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:42.371513 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:42.371483 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:42.612447 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:42.612409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" event={"ID":"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de","Type":"ContainerStarted","Data":"03726855e1c75092f0bf9dd2f85a43e597c8df24868e9b17acc6add9597d0098"} Sep 17 18:12:43.373674 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.373641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:43.373817 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:43.373785 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:43.374152 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.374131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:43.374253 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:43.374228 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:43.617271 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.617176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" event={"ID":"ac37dc63-b27c-4e5a-bc63-e2f9504ce7de","Type":"ContainerStarted","Data":"e5db271be80f97bb433365327a47fab6ef778dfe2f3939f07b4badcb5d182020"} Sep 17 18:12:43.621049 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.621030 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 18:12:43.621175 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.621054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"03c313e81b146a2f4edf7343c1fd04a6b2996fa3fe860594f04a4a1a90fda100"} Sep 17 18:12:43.637348 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:43.637306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss4z7" podStartSLOduration=4.133626589 podStartE2EDuration="24.637293139s" totalImagesPullingTime="20.50366655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:43.637020521 +0000 UTC m=+24.768491026" watchObservedRunningTime="2026-09-17 18:12:43.637293139 +0000 UTC m=+24.768763643" Sep 17 18:12:44.371607 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:44.371571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:44.371801 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:44.371679 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:44.685957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:44.685870 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:44.686393 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:44.685982 2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 18:12:44.686713 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:44.686677 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2d7wq" Sep 17 18:12:44.762120 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:44.762094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:45.371156 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.370966 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:45.371330 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.370995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:45.371330 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:45.371263 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:45.371330 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:45.371319 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:45.631421 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.631238 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" event={"ID":"0f136a54-692c-4341-9ab7-842badca08d8","Type":"ContainerStarted","Data":"5d3535e98d3167ad9312dbbbe5296807fed24d6138d8666a19dde1e39153e67b"} Sep 17 18:12:45.631421 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.631317 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:45.631822 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.631448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:45.631822 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.631591 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:45.651706 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.651500 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:45.652724 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.652525 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:12:45.668684 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:45.668196 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" podStartSLOduration=8.788867472 podStartE2EDuration="26.668178618s" totalImagesPullingTime="17.879311146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:45.66767567 +0000 UTC m=+26.799146175" watchObservedRunningTime="2026-09-17 18:12:45.668178618 +0000 UTC m=+26.799649125" Sep 17 18:12:46.371850 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:46.371821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:46.372487 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:46.371919 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:46.635211 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:46.635129 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="0882b3e1f10d25a9a0f174d68488168cf13be4c9a1ce93ba7109fb74ad1617c3" exitCode=0 Sep 17 18:12:46.635348 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:46.635215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"0882b3e1f10d25a9a0f174d68488168cf13be4c9a1ce93ba7109fb74ad1617c3"} Sep 17 18:12:47.372150 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.371964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:47.372730 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.371987 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:47.372730 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:47.372242 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:47.372730 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:47.372296 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:47.850824 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.850796 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4w6hg"] Sep 17 18:12:47.850946 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.850911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:47.851023 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:47.851001 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:47.860435 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.860407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gth8h"] Sep 17 18:12:47.860612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.860571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:47.860670 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:47.860653 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:47.861032 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.861010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-clwkx"] Sep 17 18:12:47.861127 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:47.861095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:47.861186 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:47.861170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:48.641008 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:48.640974 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="d4d9a4695399e8c14afc36f44bed0144a1a94c9b26ac15e60041b964e6e004a8" exitCode=0 Sep 17 18:12:48.641526 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:48.641041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"d4d9a4695399e8c14afc36f44bed0144a1a94c9b26ac15e60041b964e6e004a8"} Sep 17 18:12:49.373174 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:49.373144 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:49.373356 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:49.373233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:49.373356 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:49.373282 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:49.373356 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:49.373312 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:49.373525 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:49.373353 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:49.373525 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:49.373461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:50.648690 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:50.648487 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="cb86444d98438453da65b344f0d9317628aca7ce945dfcaddd672a2984accd26" exitCode=0 Sep 17 18:12:50.648690 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:50.648567 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"cb86444d98438453da65b344f0d9317628aca7ce945dfcaddd672a2984accd26"} Sep 17 18:12:51.371469 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:51.371438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:51.371652 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:51.371445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:51.371652 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:51.371560 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clwkx" podUID="153d2612-ba28-4f30-9aec-64e7d3afc04d" Sep 17 18:12:51.371652 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:51.371445 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:51.371652 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:51.371626 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4w6hg" podUID="1d2031ff-d0de-4aa5-88fe-41533edd24dd" Sep 17 18:12:51.371861 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:51.371694 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gth8h" podUID="ac729035-33a8-4820-a49a-edd5e96875f6" Sep 17 18:12:53.001517 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.001483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:53.001997 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.001552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:53.001997 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.001657 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:53.001997 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.001714 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:53.001997 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.001734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret podName:153d2612-ba28-4f30-9aec-64e7d3afc04d nodeName:}" failed. No retries permitted until 2026-09-17 18:13:25.001716656 +0000 UTC m=+66.133187154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret") pod "global-pull-secret-syncer-clwkx" (UID: "153d2612-ba28-4f30-9aec-64e7d3afc04d") : object "kube-system"/"original-pull-secret" not registered Sep 17 18:12:53.001997 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.001785 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:25.001746963 +0000 UTC m=+66.133217446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 18:12:53.102750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.102678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:53.102887 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.102829 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 18:12:53.102887 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.102850 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 18:12:53.102887 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.102860 2579 projected.go:196] Error preparing data for projected volume kube-api-access-wxn27 for pod openshift-network-diagnostics/network-check-target-4w6hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:53.102980 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.102908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27 podName:1d2031ff-d0de-4aa5-88fe-41533edd24dd nodeName:}" failed. No retries permitted until 2026-09-17 18:13:25.102895514 +0000 UTC m=+66.234366015 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wxn27" (UniqueName: "kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27") pod "network-check-target-4w6hg" (UID: "1d2031ff-d0de-4aa5-88fe-41533edd24dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 18:12:53.105410 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.105387 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-166.ec2.internal" event="NodeReady" Sep 17 18:12:53.105519 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.105498 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 18:12:53.203630 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.202848 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-86sxm"] Sep 17 18:12:53.204898 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.204874 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bncbx"] Sep 17 18:12:53.205030 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.205015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.206729 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.206713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.213385 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.213339 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 18:12:53.213517 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.213505 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8z7dx\"" Sep 17 18:12:53.213575 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.213526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 18:12:53.213652 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.213640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 18:12:53.213759 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.213742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 18:12:53.218848 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.218833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvj69\"" Sep 17 18:12:53.219830 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.219816 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 18:12:53.238130 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.237992 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86sxm"] Sep 17 18:12:53.238653 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.238632 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bncbx"] Sep 17 18:12:53.303870 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.303837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwj5l\" (UniqueName: \"kubernetes.io/projected/b6dd2186-5502-43a2-87a7-4408ba3a80e9-kube-api-access-qwj5l\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.304017 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.303876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-cert\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.304017 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.303938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6dd2186-5502-43a2-87a7-4408ba3a80e9-config-volume\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.304017 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.303982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd2186-5502-43a2-87a7-4408ba3a80e9-tmp-dir\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.304162 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.304145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.304205 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.304184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjhtx\" (UniqueName: \"kubernetes.io/projected/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-kube-api-access-vjhtx\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.371189 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.371098 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:12:53.371189 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.371139 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:12:53.371415 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.371206 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:12:53.376249 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.376228 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:12:53.376477 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.376462 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4j8ws\"" Sep 17 18:12:53.376682 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.376668 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jkgg\"" Sep 17 18:12:53.376862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.376849 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:12:53.377063 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.377049 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:12:53.377304 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.377286 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:12:53.404757 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.404735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6dd2186-5502-43a2-87a7-4408ba3a80e9-config-volume\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.404852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.404791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd2186-5502-43a2-87a7-4408ba3a80e9-tmp-dir\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.404852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.404848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.404957 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.404939 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:12:53.405002 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.404994 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:53.904976475 +0000 UTC m=+35.036446970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:12:53.405134 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.405116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dd2186-5502-43a2-87a7-4408ba3a80e9-tmp-dir\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.405187 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.405177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjhtx\" (UniqueName: \"kubernetes.io/projected/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-kube-api-access-vjhtx\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.405245 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.405215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwj5l\" (UniqueName: \"kubernetes.io/projected/b6dd2186-5502-43a2-87a7-4408ba3a80e9-kube-api-access-qwj5l\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.405294 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.405243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-cert\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.405513 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.405494 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b6dd2186-5502-43a2-87a7-4408ba3a80e9-config-volume\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.409644 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.409623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-cert\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.419899 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.419877 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwj5l\" (UniqueName: \"kubernetes.io/projected/b6dd2186-5502-43a2-87a7-4408ba3a80e9-kube-api-access-qwj5l\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.420109 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.420094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjhtx\" (UniqueName: \"kubernetes.io/projected/4316ca47-2fc4-4a59-aa9d-715ec791ad6c-kube-api-access-vjhtx\") pod \"ingress-canary-bncbx\" (UID: \"4316ca47-2fc4-4a59-aa9d-715ec791ad6c\") " pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.422654 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.422610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:53.520981 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.520949 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bncbx" Sep 17 18:12:53.531198 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.531150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:53.802865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.802832 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bncbx"] Sep 17 18:12:53.806627 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:12:53.806604 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4316ca47_2fc4_4a59_aa9d_715ec791ad6c.slice/crio-77d9eb2120d0b30d0ee0d0716601738556bcc891c8c4bd4963c5aa7fcccf6425 WatchSource:0}: Error finding container 77d9eb2120d0b30d0ee0d0716601738556bcc891c8c4bd4963c5aa7fcccf6425: Status 404 returned error can't find the container with id 77d9eb2120d0b30d0ee0d0716601738556bcc891c8c4bd4963c5aa7fcccf6425 Sep 17 18:12:53.909502 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:53.909468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:53.909658 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.909636 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:12:53.909712 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:53.909702 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:54.909688415 +0000 UTC m=+36.041158915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:12:54.660074 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:54.660024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bncbx" event={"ID":"4316ca47-2fc4-4a59-aa9d-715ec791ad6c","Type":"ContainerStarted","Data":"77d9eb2120d0b30d0ee0d0716601738556bcc891c8c4bd4963c5aa7fcccf6425"} Sep 17 18:12:54.918746 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:54.918665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:54.918906 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:54.918836 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:12:54.918960 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:54.918907 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:12:56.918886348 +0000 UTC m=+38.050356842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:12:56.141602 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:56.141564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:56.232768 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:56.232737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:56.305746 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:56.305718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:56.934759 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:56.934728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:12:56.934938 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:56.934867 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:12:56.935003 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:12:56.934943 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:00.934922401 +0000 UTC m=+42.066392900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:12:57.564355 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.564325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:57.627872 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.627845 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:57.668886 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.668851 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="a7c32a7ac2d12c4da5ca1807347b0746b367b2496149653a748d8e7c87129347" exitCode=0 Sep 17 18:12:57.669027 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.668919 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"a7c32a7ac2d12c4da5ca1807347b0746b367b2496149653a748d8e7c87129347"} Sep 17 18:12:57.670469 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.670446 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bncbx" event={"ID":"4316ca47-2fc4-4a59-aa9d-715ec791ad6c","Type":"ContainerStarted","Data":"86c629cf44a9c4a5171e8839f95faf49192e34c5239f7a35fa44a14895102806"} Sep 17 18:12:57.724815 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:57.724772 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bncbx" podStartSLOduration=1.543625426 podStartE2EDuration="4.724756731s" totalImagesPullingTime="3.181131305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:57.723739294 +0000 UTC m=+38.855209795" watchObservedRunningTime="2026-09-17 18:12:57.724756731 +0000 UTC m=+38.856227235" Sep 17 18:12:58.676094 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:58.676062 2579 generic.go:356] "Generic (PLEG): container finished" podID="76e2edb4-629e-4837-acfd-633370c1a1f3" containerID="2425f13417581f72c6a9ab7b2f47ac00b91e68661cec07a81df5d4aa5a96e51d" exitCode=0 Sep 17 18:12:58.676465 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:58.676110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerDied","Data":"2425f13417581f72c6a9ab7b2f47ac00b91e68661cec07a81df5d4aa5a96e51d"} Sep 17 18:12:59.684070 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:59.684034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" event={"ID":"76e2edb4-629e-4837-acfd-633370c1a1f3","Type":"ContainerStarted","Data":"bcd9a132083248dd55234bae2592240f7405fe4f55a3c64b95978bda22183f5b"} Sep 17 18:12:59.709135 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:59.709082 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qmdf2" podStartSLOduration=9.523110506 podStartE2EDuration="40.709062641s" totalImagesPullingTime="31.185952135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:12:59.707853297 +0000 UTC m=+40.839323814" watchObservedRunningTime="2026-09-17 18:12:59.709062641 +0000 UTC m=+40.840533148" Sep 17 18:12:59.840153 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:59.840124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:12:59.920278 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:12:59.920253 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:00.961147 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:00.961109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:13:00.961517 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:00.961242 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:13:00.961517 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:00.961299 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:08.961282868 +0000 UTC m=+50.092753366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:13:01.898765 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:01.898730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:01.996847 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:01.996813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:09.013890 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:09.013852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:13:09.014307 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:09.013956 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:13:09.014307 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:09.014008 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:25.013994587 +0000 UTC m=+66.145465083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:13:16.446572 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:16.446521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:17.651274 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:17.651250 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nn7p" Sep 17 18:13:17.785793 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:17.785754 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:17.857753 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:17.857723 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:25.022937 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.022900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:13:25.023430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.022962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:13:25.023430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.023003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:13:25.023430 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:25.023104 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:13:25.023430 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:25.023181 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:57.023163581 +0000 UTC m=+98.154634079 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:13:25.028629 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.028610 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 18:13:25.028715 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.028638 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 18:13:25.033770 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:25.033756 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 18:13:25.033830 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:25.033818 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs podName:ac729035-33a8-4820-a49a-edd5e96875f6 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:29.033800468 +0000 UTC m=+130.165270961 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs") pod "network-metrics-daemon-gth8h" (UID: "ac729035-33a8-4820-a49a-edd5e96875f6") : secret "metrics-daemon-secret" not found Sep 17 18:13:25.037099 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.037078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/153d2612-ba28-4f30-9aec-64e7d3afc04d-original-pull-secret\") pod \"global-pull-secret-syncer-clwkx\" (UID: \"153d2612-ba28-4f30-9aec-64e7d3afc04d\") " pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:13:25.123866 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.123825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:13:25.126615 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.126599 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 18:13:25.136705 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.136690 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 18:13:25.147918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.147898 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxn27\" (UniqueName: \"kubernetes.io/projected/1d2031ff-d0de-4aa5-88fe-41533edd24dd-kube-api-access-wxn27\") pod \"network-check-target-4w6hg\" (UID: \"1d2031ff-d0de-4aa5-88fe-41533edd24dd\") " pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:13:25.184917 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.184892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clwkx" Sep 17 18:13:25.199451 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.199432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4j8ws\"" Sep 17 18:13:25.207110 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.207089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:13:25.457202 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.457132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-clwkx"] Sep 17 18:13:25.460391 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:13:25.460361 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153d2612_ba28_4f30_9aec_64e7d3afc04d.slice/crio-6bc9534d2011e880746dfe7368c1c3af21774a66943e0897460864e298907054 WatchSource:0}: Error finding container 6bc9534d2011e880746dfe7368c1c3af21774a66943e0897460864e298907054: Status 404 returned error can't find the container with id 6bc9534d2011e880746dfe7368c1c3af21774a66943e0897460864e298907054 Sep 17 18:13:25.483617 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.483592 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4w6hg"] Sep 17 18:13:25.488132 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:13:25.486612 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2031ff_d0de_4aa5_88fe_41533edd24dd.slice/crio-066762839f2995490c23fd4e24f358393aad91841761c98896f3c284ed77b1c1 WatchSource:0}: Error finding container 066762839f2995490c23fd4e24f358393aad91841761c98896f3c284ed77b1c1: Status 404 returned error can't find the container with id 066762839f2995490c23fd4e24f358393aad91841761c98896f3c284ed77b1c1 Sep 17 18:13:25.740791 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.740707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-clwkx" event={"ID":"153d2612-ba28-4f30-9aec-64e7d3afc04d","Type":"ContainerStarted","Data":"6bc9534d2011e880746dfe7368c1c3af21774a66943e0897460864e298907054"} Sep 17 18:13:25.741843 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:25.741814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4w6hg" event={"ID":"1d2031ff-d0de-4aa5-88fe-41533edd24dd","Type":"ContainerStarted","Data":"066762839f2995490c23fd4e24f358393aad91841761c98896f3c284ed77b1c1"} Sep 17 18:13:31.760477 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:31.760435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4w6hg" event={"ID":"1d2031ff-d0de-4aa5-88fe-41533edd24dd","Type":"ContainerStarted","Data":"102e15c8ec655608b9244c26d0404261b5835eea3bb4284a66d988ba701beb77"} Sep 17 18:13:31.760997 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:31.760553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:13:31.761932 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:31.761910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-clwkx" event={"ID":"153d2612-ba28-4f30-9aec-64e7d3afc04d","Type":"ContainerStarted","Data":"5da9179658a1ee3dd57ae65c4b6028ca8f4018385b06c9d5598df33426323573"} Sep 17 18:13:31.786531 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:31.786485 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4w6hg" podStartSLOduration=67.62945897 podStartE2EDuration="1m12.786471325s" totalImagesPullingTime="5.157012355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:31.786371255 +0000 UTC m=+72.917841760" watchObservedRunningTime="2026-09-17 18:13:31.786471325 +0000 UTC m=+72.917941821" Sep 17 18:13:31.807810 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:31.807769 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-clwkx" podStartSLOduration=67.612711333 podStartE2EDuration="1m12.807756763s" totalImagesPullingTime="5.19504543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:31.806771051 +0000 UTC m=+72.938241555" watchObservedRunningTime="2026-09-17 18:13:31.807756763 +0000 UTC m=+72.939227308" Sep 17 18:13:36.040455 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:36.040415 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:47.521938 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.521817 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg"] Sep 17 18:13:47.525772 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.525748 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l"] Sep 17 18:13:47.525929 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.525868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.527775 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.527748 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 18:13:47.528033 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528008 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 18:13:47.528113 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528070 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:13:47.528272 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528224 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:13:47.528375 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" Sep 17 18:13:47.528432 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528394 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8zx6n\"" Sep 17 18:13:47.528432 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.528410 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 18:13:47.530196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.530179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dpbpn\"" Sep 17 18:13:47.530391 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.530375 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 18:13:47.530466 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.530451 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 18:13:47.530601 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.530585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.532572 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.532530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 18:13:47.532690 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.532676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 18:13:47.532778 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.532763 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9f56l\"" Sep 17 18:13:47.532828 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.532768 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 18:13:47.537735 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.537712 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l"] Sep 17 18:13:47.538488 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.538470 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg"] Sep 17 18:13:47.538670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.538652 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 18:13:47.543714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.543697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:13:47.577290 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2877\" (UniqueName: \"kubernetes.io/projected/eeeee892-275f-4d78-8ca6-acb6de23642c-kube-api-access-h2877\") pod \"volume-data-source-validator-5c4db8bdf9-4mr2l\" (UID: \"eeeee892-275f-4d78-8ca6-acb6de23642c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dqr\" (UniqueName: \"kubernetes.io/projected/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-kube-api-access-c7dqr\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.577449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577431 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577742 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577742 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577742 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577742 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.577742 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.577620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdbkd\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.621170 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.621138 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh"] Sep 17 18:13:47.623819 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.623803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.626283 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.626265 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 18:13:47.626946 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.626927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 18:13:47.626946 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.626946 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bfl5l\"" Sep 17 18:13:47.627116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.626991 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 18:13:47.627244 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.627230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 18:13:47.636135 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.636100 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh"] Sep 17 18:13:47.678968 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.678937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.678968 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.678969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.679206 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.678994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2877\" (UniqueName: \"kubernetes.io/projected/eeeee892-275f-4d78-8ca6-acb6de23642c-kube-api-access-h2877\") pod \"volume-data-source-validator-5c4db8bdf9-4mr2l\" (UID: \"eeeee892-275f-4d78-8ca6-acb6de23642c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" Sep 17 18:13:47.679206 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:47.679099 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 18:13:47.679206 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679206 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-kube-api-access-z88p9\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.679206 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:47.679119 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b64bfc9d-dfjpc: secret "image-registry-tls" not found Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:47.679257 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls podName:4e5f94c1-7105-45e3-99d6-70ff0f7bb806 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:48.179236321 +0000 UTC m=+89.310706818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls") pod "image-registry-86b64bfc9d-dfjpc" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806") : secret "image-registry-tls" not found Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dqr\" (UniqueName: \"kubernetes.io/projected/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-kube-api-access-c7dqr\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.679841 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679841 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.679841 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.679841 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679576 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.679841 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.679591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdbkd\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.680444 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.680422 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.680592 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.680573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.680748 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.680728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.681708 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.681687 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.681866 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.681842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.681974 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.681855 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.689427 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.689399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2877\" (UniqueName: \"kubernetes.io/projected/eeeee892-275f-4d78-8ca6-acb6de23642c-kube-api-access-h2877\") pod \"volume-data-source-validator-5c4db8bdf9-4mr2l\" (UID: \"eeeee892-275f-4d78-8ca6-acb6de23642c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" Sep 17 18:13:47.690063 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.690035 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dqr\" (UniqueName: \"kubernetes.io/projected/eec0c70b-d7aa-4c2b-933b-9f630ea4411f-kube-api-access-c7dqr\") pod \"kube-storage-version-migrator-operator-55889f7b47-b4lfg\" (UID: \"eec0c70b-d7aa-4c2b-933b-9f630ea4411f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.690197 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.690181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdbkd\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.690494 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.690480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:47.706798 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.706779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:47.780457 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.780403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.780561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.780495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-kube-api-access-z88p9\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.780561 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.780530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.780669 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:47.780653 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:47.780753 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:47.780742 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:48.280715882 +0000 UTC m=+89.412186369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:47.781150 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.781133 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.788222 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.788204 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88p9\" (UniqueName: \"kubernetes.io/projected/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-kube-api-access-z88p9\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:47.807017 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.806992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:47.835861 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.835845 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" Sep 17 18:13:47.843614 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:47.843595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" Sep 17 18:13:48.103846 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.103777 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg"] Sep 17 18:13:48.106598 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:13:48.106569 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec0c70b_d7aa_4c2b_933b_9f630ea4411f.slice/crio-8401b57bae8f14b02a28864393e92cf44053c83a8877feca9391cdd15c32ef86 WatchSource:0}: Error finding container 8401b57bae8f14b02a28864393e92cf44053c83a8877feca9391cdd15c32ef86: Status 404 returned error can't find the container with id 8401b57bae8f14b02a28864393e92cf44053c83a8877feca9391cdd15c32ef86 Sep 17 18:13:48.113160 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.113140 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l"] Sep 17 18:13:48.115954 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:13:48.115933 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeee892_275f_4d78_8ca6_acb6de23642c.slice/crio-139ea71367f9027ceb8d27ce28a75e5d333994d05c22dec07a207ade1e9f72de WatchSource:0}: Error finding container 139ea71367f9027ceb8d27ce28a75e5d333994d05c22dec07a207ade1e9f72de: Status 404 returned error can't find the container with id 139ea71367f9027ceb8d27ce28a75e5d333994d05c22dec07a207ade1e9f72de Sep 17 18:13:48.183134 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.183092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:48.183291 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:48.183243 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 18:13:48.183291 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:48.183267 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b64bfc9d-dfjpc: secret "image-registry-tls" not found Sep 17 18:13:48.183365 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:48.183323 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls podName:4e5f94c1-7105-45e3-99d6-70ff0f7bb806 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:49.183307682 +0000 UTC m=+90.314778180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls") pod "image-registry-86b64bfc9d-dfjpc" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806") : secret "image-registry-tls" not found Sep 17 18:13:48.283412 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.283378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:48.283609 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:48.283566 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:48.283689 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:48.283640 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:49.283621163 +0000 UTC m=+90.415091667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:48.804250 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.804212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" event={"ID":"eeeee892-275f-4d78-8ca6-acb6de23642c","Type":"ContainerStarted","Data":"139ea71367f9027ceb8d27ce28a75e5d333994d05c22dec07a207ade1e9f72de"} Sep 17 18:13:48.805431 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:48.805400 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" event={"ID":"eec0c70b-d7aa-4c2b-933b-9f630ea4411f","Type":"ContainerStarted","Data":"8401b57bae8f14b02a28864393e92cf44053c83a8877feca9391cdd15c32ef86"} Sep 17 18:13:49.188930 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:49.188843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:49.189089 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:49.189044 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 18:13:49.189089 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:49.189061 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b64bfc9d-dfjpc: secret "image-registry-tls" not found Sep 17 18:13:49.189200 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:49.189121 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls podName:4e5f94c1-7105-45e3-99d6-70ff0f7bb806 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:51.189103589 +0000 UTC m=+92.320574077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls") pod "image-registry-86b64bfc9d-dfjpc" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806") : secret "image-registry-tls" not found Sep 17 18:13:49.290215 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:49.290171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:49.290397 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:49.290287 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:49.290397 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:49.290370 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:51.290348483 +0000 UTC m=+92.421818977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:49.810920 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:49.810121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" event={"ID":"eeeee892-275f-4d78-8ca6-acb6de23642c","Type":"ContainerStarted","Data":"407345625a0991d93406d2f0ca78cd3c37f31dda7918f78088666ead9ae92d57"} Sep 17 18:13:49.932332 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:49.932290 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:50.033705 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:50.033669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:50.814039 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:50.814001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" event={"ID":"eec0c70b-d7aa-4c2b-933b-9f630ea4411f","Type":"ContainerStarted","Data":"1366a8b9444abffb2897d8989a024349b5d9f5eaa874b4b170394f74abc79cb5"} Sep 17 18:13:50.830830 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:50.830775 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" podStartSLOduration=1.9366898620000002 podStartE2EDuration="3.83075942s" totalImagesPullingTime="1.894069558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:50.830155881 +0000 UTC m=+91.961626390" watchObservedRunningTime="2026-09-17 18:13:50.83075942 +0000 UTC m=+91.962229925" Sep 17 18:13:50.830972 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:50.830908 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-4mr2l" podStartSLOduration=2.477029665 podStartE2EDuration="3.830903847s" totalImagesPullingTime="1.353874182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:13:49.826568239 +0000 UTC m=+90.958038741" watchObservedRunningTime="2026-09-17 18:13:50.830903847 +0000 UTC m=+91.962374352" Sep 17 18:13:51.206179 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.206072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:51.206333 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.206233 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 18:13:51.206333 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.206255 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b64bfc9d-dfjpc: secret "image-registry-tls" not found Sep 17 18:13:51.206333 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.206313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls podName:4e5f94c1-7105-45e3-99d6-70ff0f7bb806 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:55.206296435 +0000 UTC m=+96.337766918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls") pod "image-registry-86b64bfc9d-dfjpc" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806") : secret "image-registry-tls" not found Sep 17 18:13:51.306894 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.306857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:51.307114 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.307042 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:51.307193 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.307128 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:13:55.307107691 +0000 UTC m=+96.438578187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:51.539930 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.539899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:51.629106 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.629054 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:51.718202 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.718168 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:51.732986 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.732957 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rjfk9"] Sep 17 18:13:51.736131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.736116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.740143 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.740122 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 18:13:51.740350 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.740337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 18:13:51.740406 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.740382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xrwt8\"" Sep 17 18:13:51.740406 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.740400 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 18:13:51.740715 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.740701 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 18:13:51.746290 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.746271 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjfk9"] Sep 17 18:13:51.788212 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.788187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:51.810315 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.810248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.810315 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.810287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8cd\" (UniqueName: \"kubernetes.io/projected/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-api-access-gn8cd\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.810453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.810372 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-crio-socket\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.810453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.810405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-data-volume\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.810453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.810432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.910923 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.910900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-crio-socket\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.910927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-data-volume\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.910943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.911030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-crio-socket\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.911040 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.911086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.911119 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:52.4111018 +0000 UTC m=+93.542572303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : configmap "kube-rbac-proxy" not found Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.911170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8cd\" (UniqueName: \"kubernetes.io/projected/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-api-access-gn8cd\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.911179 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:51.911229 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:52.411214027 +0000 UTC m=+93.542684523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:13:51.911343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.911342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-data-volume\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:51.918598 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:51.918568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8cd\" (UniqueName: \"kubernetes.io/projected/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-api-access-gn8cd\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:52.414974 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:52.414939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:52.415131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:52.415007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:52.415131 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:52.415067 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:13:52.415215 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:52.415139 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:53.415124069 +0000 UTC m=+94.546594552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : configmap "kube-rbac-proxy" not found Sep 17 18:13:52.415215 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:52.415142 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:13:52.415215 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:52.415182 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:53.415170303 +0000 UTC m=+94.546640786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:13:52.504257 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:52.504229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:52.560448 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:52.560405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:52.928264 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:52.928231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:53.236159 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:53.236073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:53.335752 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:53.335720 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:53.422726 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:53.422694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:53.422889 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:53.422755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:53.422889 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:53.422816 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:13:53.422889 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:53.422825 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:13:53.422889 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:53.422883 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:55.422869946 +0000 UTC m=+96.554340443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:13:53.423045 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:53.422899 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:55.422892711 +0000 UTC m=+96.554363232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : configmap "kube-rbac-proxy" not found Sep 17 18:13:54.059411 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:54.059376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:54.134926 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:54.134895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:54.477331 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:54.477257 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnvbj_7b548676-bb64-40f1-af2b-8c2c84d15ab4/dns-node-resolver/0.log" Sep 17 18:13:54.842793 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:54.842761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:54.904208 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:54.904179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:55.236407 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.236313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:13:55.236813 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.236470 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 18:13:55.236813 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.236487 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b64bfc9d-dfjpc: secret "image-registry-tls" not found Sep 17 18:13:55.236813 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.236561 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls podName:4e5f94c1-7105-45e3-99d6-70ff0f7bb806 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:03.236527455 +0000 UTC m=+104.367997941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls") pod "image-registry-86b64bfc9d-dfjpc" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806") : secret "image-registry-tls" not found Sep 17 18:13:55.337369 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.337331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:13:55.337524 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.337463 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:55.337524 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.337516 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:03.33750379 +0000 UTC m=+104.468974274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:13:55.438628 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.438578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:55.438798 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.438657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:55.438798 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.438706 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:13:55.438798 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.438764 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:13:55.438798 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.438796 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:59.438777503 +0000 UTC m=+100.570247987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : configmap "kube-rbac-proxy" not found Sep 17 18:13:55.438931 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:55.438819 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:13:59.438807266 +0000 UTC m=+100.570277749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:13:55.477650 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.477628 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2fpd_0f40bddb-54de-4f40-bf34-1b232eddd4e4/node-ca/0.log" Sep 17 18:13:55.821707 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:55.821677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:56.077326 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:56.077253 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bncbx_4316ca47-2fc4-4a59-aa9d-715ec791ad6c/serve-healthcheck-canary/0.log" Sep 17 18:13:57.050132 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:57.050083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:13:57.050505 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:57.050226 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 18:13:57.050505 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:57.050286 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls podName:b6dd2186-5502-43a2-87a7-4408ba3a80e9 nodeName:}" failed. No retries permitted until 2026-09-17 18:15:01.050272135 +0000 UTC m=+162.181742617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls") pod "dns-default-86sxm" (UID: "b6dd2186-5502-43a2-87a7-4408ba3a80e9") : secret "dns-default-metrics-tls" not found Sep 17 18:13:57.078143 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:57.078120 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-b4lfg_eec0c70b-d7aa-4c2b-933b-9f630ea4411f/kube-storage-version-migrator-operator/0.log" Sep 17 18:13:59.017376 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.017344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:59.366128 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.366043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:59.470439 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.470401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:59.470660 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.470485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:13:59.470660 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:59.470510 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 18:13:59.470660 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:59.470596 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:14:07.470570937 +0000 UTC m=+108.602041425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : configmap "kube-rbac-proxy" not found Sep 17 18:13:59.470660 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:59.470633 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:13:59.470877 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:13:59.470701 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:14:07.470686376 +0000 UTC m=+108.602156860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:13:59.598031 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.597987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:59.707341 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.707260 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:13:59.800790 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:13:59.800761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:00.056523 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:00.056487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:01.246227 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:01.246189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:01.453692 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:01.453649 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:01.678814 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:01.678779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:01.850528 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:01.850498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:02.113577 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:02.113533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:02.528633 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:02.528602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:02.766328 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:02.766296 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4w6hg" Sep 17 18:14:02.847789 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:02.847708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.043404 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.043376 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.157754 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.157686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.299179 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.299124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:03.301680 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.301656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"image-registry-86b64bfc9d-dfjpc\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:03.400313 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.400285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:14:03.400454 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:03.400398 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 18:14:03.400454 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:03.400447 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls podName:a5fbe798-f193-4d7c-ba0a-edcbb8c3e258 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:19.400433953 +0000 UTC m=+120.531904450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-xnnrh" (UID: "a5fbe798-f193-4d7c-ba0a-edcbb8c3e258") : secret "cluster-monitoring-operator-tls" not found Sep 17 18:14:03.449054 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.448984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:03.517404 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.517364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.647594 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.647561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.720946 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.720870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:14:03.725182 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:03.725156 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5f94c1_7105_45e3_99d6_70ff0f7bb806.slice/crio-89a4354e59a1e4d7864f42109f45d58de5afb9a551cb223e8e36f4d7382fa365 WatchSource:0}: Error finding container 89a4354e59a1e4d7864f42109f45d58de5afb9a551cb223e8e36f4d7382fa365: Status 404 returned error can't find the container with id 89a4354e59a1e4d7864f42109f45d58de5afb9a551cb223e8e36f4d7382fa365 Sep 17 18:14:03.838372 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.838344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:03.846872 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.846845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" event={"ID":"4e5f94c1-7105-45e3-99d6-70ff0f7bb806","Type":"ContainerStarted","Data":"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3"} Sep 17 18:14:03.846988 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.846886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" event={"ID":"4e5f94c1-7105-45e3-99d6-70ff0f7bb806","Type":"ContainerStarted","Data":"89a4354e59a1e4d7864f42109f45d58de5afb9a551cb223e8e36f4d7382fa365"} Sep 17 18:14:03.846988 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.846915 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:03.864711 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.864660 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" podStartSLOduration=16.864646069 podStartE2EDuration="16.864646069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:03.864452553 +0000 UTC m=+104.995923058" watchObservedRunningTime="2026-09-17 18:14:03.864646069 +0000 UTC m=+104.996116574" Sep 17 18:14:03.900193 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:03.900160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:04.058267 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:04.058231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:04.736363 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:04.736314 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:05.247754 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:05.247719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:05.518223 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:05.518171 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:05.646519 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:05.646473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:05.721630 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:05.721592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:05.847291 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:05.847197 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:06.043223 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:06.043188 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:06.843581 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:06.843534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:07.241974 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.241884 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:07.533826 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.533779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:07.534013 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.533868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:07.534013 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:07.533992 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 18:14:07.534126 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:07.534063 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls podName:ce88d485-0ae2-4abd-ac63-21d1d3397b6a nodeName:}" failed. No retries permitted until 2026-09-17 18:14:23.534043814 +0000 UTC m=+124.665514506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rjfk9" (UID: "ce88d485-0ae2-4abd-ac63-21d1d3397b6a") : secret "insights-runtime-extractor-tls" not found Sep 17 18:14:07.534367 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.534344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:07.641400 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.641362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:07.839678 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:07.839591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:08.236993 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:08.236911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:08.842728 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:08.842687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:09.249057 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:09.248973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:09.438940 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:09.438905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:09.849361 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:09.849323 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:10.048305 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:10.048270 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:12.247418 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:12.247385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:12.302112 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:12.302084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:17.418439 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.418412 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls"] Sep 17 18:14:17.420696 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.420673 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.423254 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.423226 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 17 18:14:17.423942 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.423916 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 18:14:17.424059 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.423953 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 18:14:17.424128 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.424110 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 18:14:17.439140 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.439112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls"] Sep 17 18:14:17.446289 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.446268 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:14:17.506380 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.506343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-tmp\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.506572 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.506391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldj2q\" (UniqueName: \"kubernetes.io/projected/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-kube-api-access-ldj2q\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.506572 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.506471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.568918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.568882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:17.606936 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.606903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-tmp\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.607067 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.606950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldj2q\" (UniqueName: \"kubernetes.io/projected/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-kube-api-access-ldj2q\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.607067 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.607034 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.607357 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.607337 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-tmp\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.609508 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.609489 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.621533 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.621511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldj2q\" (UniqueName: \"kubernetes.io/projected/7d710f26-d4d2-46dd-9dee-91f7d382f4e9-kube-api-access-ldj2q\") pod \"klusterlet-addon-workmgr-6bbb57c8db-r6hls\" (UID: \"7d710f26-d4d2-46dd-9dee-91f7d382f4e9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.674345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.674273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:17.735228 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.735198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:17.775029 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.774995 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:17.999300 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:17.999222 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls"] Sep 17 18:14:18.001875 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:18.001842 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d710f26_d4d2_46dd_9dee_91f7d382f4e9.slice/crio-da8a130d7b3a4494933601500f23b9e09b48b4268684dafaafec88750b1f0556 WatchSource:0}: Error finding container da8a130d7b3a4494933601500f23b9e09b48b4268684dafaafec88750b1f0556: Status 404 returned error can't find the container with id da8a130d7b3a4494933601500f23b9e09b48b4268684dafaafec88750b1f0556 Sep 17 18:14:18.894389 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:18.894299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" event={"ID":"7d710f26-d4d2-46dd-9dee-91f7d382f4e9","Type":"ContainerStarted","Data":"da8a130d7b3a4494933601500f23b9e09b48b4268684dafaafec88750b1f0556"} Sep 17 18:14:19.422553 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:19.422496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:14:19.425598 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:19.425568 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5fbe798-f193-4d7c-ba0a-edcbb8c3e258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-xnnrh\" (UID: \"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:14:19.434105 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:19.433893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bfl5l\"" Sep 17 18:14:19.443008 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:19.442978 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" Sep 17 18:14:19.727283 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:19.727205 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh"] Sep 17 18:14:20.368229 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:20.368193 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5fbe798_f193_4d7c_ba0a_edcbb8c3e258.slice/crio-871508ab37a6324889f6548d1f3eb9eb7c5f742bcc5da78780e2438c3585e3e2 WatchSource:0}: Error finding container 871508ab37a6324889f6548d1f3eb9eb7c5f742bcc5da78780e2438c3585e3e2: Status 404 returned error can't find the container with id 871508ab37a6324889f6548d1f3eb9eb7c5f742bcc5da78780e2438c3585e3e2 Sep 17 18:14:20.903836 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:20.903800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" event={"ID":"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258","Type":"ContainerStarted","Data":"871508ab37a6324889f6548d1f3eb9eb7c5f742bcc5da78780e2438c3585e3e2"} Sep 17 18:14:21.909296 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:21.909258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" event={"ID":"7d710f26-d4d2-46dd-9dee-91f7d382f4e9","Type":"ContainerStarted","Data":"1110b207d4e5a7eabc0919f415b7d1e65e8bf1c7be0fca04b4f0425a9740374e"} Sep 17 18:14:21.909714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:21.909480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:21.911157 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:21.911134 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" Sep 17 18:14:21.925100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:21.925057 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bbb57c8db-r6hls" podStartSLOduration=1.13073848 podStartE2EDuration="4.925040515s" totalImagesPullingTime="3.794302035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:21.924047513 +0000 UTC m=+123.055518017" watchObservedRunningTime="2026-09-17 18:14:21.925040515 +0000 UTC m=+123.056511022" Sep 17 18:14:23.154811 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.154776 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.258657 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.258630 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.530762 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.530734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.563286 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.563261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:23.565803 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.565781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce88d485-0ae2-4abd-ac63-21d1d3397b6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rjfk9\" (UID: \"ce88d485-0ae2-4abd-ac63-21d1d3397b6a\") " pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:23.630001 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.629972 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.697773 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.697738 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc"] Sep 17 18:14:23.701182 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.701153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.719877 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.719853 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc"] Sep 17 18:14:23.720003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.719940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:23.722030 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.722009 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 18:14:23.722284 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.722266 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6xjwv\"" Sep 17 18:14:23.764483 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.764442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b22cc4f1-7732-4d03-80a3-20d5f80d0e4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bfckc\" (UID: \"b22cc4f1-7732-4d03-80a3-20d5f80d0e4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:23.783300 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.783227 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:23.847381 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.847350 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xrwt8\"" Sep 17 18:14:23.855870 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.855849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rjfk9" Sep 17 18:14:23.865443 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.865420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b22cc4f1-7732-4d03-80a3-20d5f80d0e4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bfckc\" (UID: \"b22cc4f1-7732-4d03-80a3-20d5f80d0e4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:23.867865 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.867840 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b22cc4f1-7732-4d03-80a3-20d5f80d0e4e-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-bfckc\" (UID: \"b22cc4f1-7732-4d03-80a3-20d5f80d0e4e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:23.917913 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.917870 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" event={"ID":"a5fbe798-f193-4d7c-ba0a-edcbb8c3e258","Type":"ContainerStarted","Data":"148ce4dc69a267812068a1af15711e34658c49163d96c62437dc9972f2eaff5e"} Sep 17 18:14:23.933792 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:23.933719 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-xnnrh" podStartSLOduration=34.127186744 podStartE2EDuration="36.933697439s" totalImagesPullingTime="2.806510695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:23.932380437 +0000 UTC m=+125.063850954" watchObservedRunningTime="2026-09-17 18:14:23.933697439 +0000 UTC m=+125.065167946" Sep 17 18:14:24.028840 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.028800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:24.144598 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.144570 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rjfk9"] Sep 17 18:14:24.147095 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:24.147068 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce88d485_0ae2_4abd_ac63_21d1d3397b6a.slice/crio-20c800517a392d99b5f3f14a619a39df44484c7fe391d12c3da49b1e8ac825c7 WatchSource:0}: Error finding container 20c800517a392d99b5f3f14a619a39df44484c7fe391d12c3da49b1e8ac825c7: Status 404 returned error can't find the container with id 20c800517a392d99b5f3f14a619a39df44484c7fe391d12c3da49b1e8ac825c7 Sep 17 18:14:24.293612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.293527 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc"] Sep 17 18:14:24.296098 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:24.296072 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22cc4f1_7732_4d03_80a3_20d5f80d0e4e.slice/crio-58a0dad8c0e22a483461bc6d4e410d18df5e0f8379b8e5f23924ed1062d5a6c9 WatchSource:0}: Error finding container 58a0dad8c0e22a483461bc6d4e410d18df5e0f8379b8e5f23924ed1062d5a6c9: Status 404 returned error can't find the container with id 58a0dad8c0e22a483461bc6d4e410d18df5e0f8379b8e5f23924ed1062d5a6c9 Sep 17 18:14:24.924881 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.924847 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" event={"ID":"b22cc4f1-7732-4d03-80a3-20d5f80d0e4e","Type":"ContainerStarted","Data":"58a0dad8c0e22a483461bc6d4e410d18df5e0f8379b8e5f23924ed1062d5a6c9"} Sep 17 18:14:24.926571 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.926553 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjfk9" event={"ID":"ce88d485-0ae2-4abd-ac63-21d1d3397b6a","Type":"ContainerStarted","Data":"46f1473c027aec8c626b28220518bee26b0878a5ed887caaf1d6be95e5ad552b"} Sep 17 18:14:24.926669 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.926590 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjfk9" event={"ID":"ce88d485-0ae2-4abd-ac63-21d1d3397b6a","Type":"ContainerStarted","Data":"ad7d943ebd71f3dc1bdf167c06ec060682188b3c7b7daef45e467b01155e8e4b"} Sep 17 18:14:24.926669 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:24.926617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjfk9" event={"ID":"ce88d485-0ae2-4abd-ac63-21d1d3397b6a","Type":"ContainerStarted","Data":"20c800517a392d99b5f3f14a619a39df44484c7fe391d12c3da49b1e8ac825c7"} Sep 17 18:14:25.931207 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:25.931120 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" event={"ID":"b22cc4f1-7732-4d03-80a3-20d5f80d0e4e","Type":"ContainerStarted","Data":"1f8a40159623f1c84a6b2f75d30ea20a36547c77268eb66a19e5f4f09dfc9e12"} Sep 17 18:14:25.931667 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:25.931339 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:25.935850 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:25.935829 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" Sep 17 18:14:25.946510 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:25.946467 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-bfckc" podStartSLOduration=1.623983873 podStartE2EDuration="2.946453613s" totalImagesPullingTime="1.32246974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:25.945351868 +0000 UTC m=+127.076822372" watchObservedRunningTime="2026-09-17 18:14:25.946453613 +0000 UTC m=+127.077924109" Sep 17 18:14:26.722918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.722843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:26.755451 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.755423 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s"] Sep 17 18:14:26.757399 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.757385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.759471 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.759451 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 18:14:26.760148 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.760128 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-49878\"" Sep 17 18:14:26.760229 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.760180 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 18:14:26.760291 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.760185 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 18:14:26.771049 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.771026 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s"] Sep 17 18:14:26.786765 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.786745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:26.789723 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.789706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26tqw\" (UniqueName: \"kubernetes.io/projected/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-kube-api-access-26tqw\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.789788 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.789748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.789788 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.789779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.789868 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.789857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.891146 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.891114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.891254 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.891159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.891302 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.891281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.891361 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.891349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26tqw\" (UniqueName: \"kubernetes.io/projected/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-kube-api-access-26tqw\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.891421 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:26.891400 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 18:14:26.891488 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:26.891477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls podName:dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:27.39145759 +0000 UTC m=+128.522928087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-vwp8s" (UID: "dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1") : secret "prometheus-operator-tls" not found Sep 17 18:14:26.891823 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.891808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.893635 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.893607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.899489 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.899472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26tqw\" (UniqueName: \"kubernetes.io/projected/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-kube-api-access-26tqw\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:26.935741 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.935711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rjfk9" event={"ID":"ce88d485-0ae2-4abd-ac63-21d1d3397b6a","Type":"ContainerStarted","Data":"0cb4064192840aad8b395ff908b3199ed0668790cb57f1f77aa629c606cfe144"} Sep 17 18:14:26.952833 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:26.952789 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rjfk9" podStartSLOduration=33.840544495 podStartE2EDuration="35.952772264s" totalImagesPullingTime="2.112227769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:13:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:26.952602889 +0000 UTC m=+128.084073396" watchObservedRunningTime="2026-09-17 18:14:26.952772264 +0000 UTC m=+128.084242769" Sep 17 18:14:27.232313 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.232275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:27.394514 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.394483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:27.396918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.396900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-vwp8s\" (UID: \"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:27.451297 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.451268 2579 patch_prober.go:28] interesting pod/image-registry-86b64bfc9d-dfjpc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 18:14:27.451433 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.451320 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 18:14:27.665784 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.665746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" Sep 17 18:14:27.933768 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:27.933747 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s"] Sep 17 18:14:27.935974 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:27.935930 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc0fcd4_7b54_412b_ad8d_b4eb14f16ce1.slice/crio-b4c647b5f63c25c3b7ce18f9985e137232aa3f68c5368503ddd921f1540913e0 WatchSource:0}: Error finding container b4c647b5f63c25c3b7ce18f9985e137232aa3f68c5368503ddd921f1540913e0: Status 404 returned error can't find the container with id b4c647b5f63c25c3b7ce18f9985e137232aa3f68c5368503ddd921f1540913e0 Sep 17 18:14:28.943829 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:28.943793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" event={"ID":"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1","Type":"ContainerStarted","Data":"b4c647b5f63c25c3b7ce18f9985e137232aa3f68c5368503ddd921f1540913e0"} Sep 17 18:14:29.108348 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.108325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:14:29.110699 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.110676 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac729035-33a8-4820-a49a-edd5e96875f6-metrics-certs\") pod \"network-metrics-daemon-gth8h\" (UID: \"ac729035-33a8-4820-a49a-edd5e96875f6\") " pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:14:29.364712 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.364675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:29.393103 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.393075 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jkgg\"" Sep 17 18:14:29.402099 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.402074 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gth8h" Sep 17 18:14:29.668928 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.668896 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gth8h"] Sep 17 18:14:29.672225 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:29.672197 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac729035_33a8_4820_a49a_edd5e96875f6.slice/crio-8c7e5d860d396a801749ccdc41d7a2fc5bd97247dc06b845f870f7d4ff66e863 WatchSource:0}: Error finding container 8c7e5d860d396a801749ccdc41d7a2fc5bd97247dc06b845f870f7d4ff66e863: Status 404 returned error can't find the container with id 8c7e5d860d396a801749ccdc41d7a2fc5bd97247dc06b845f870f7d4ff66e863 Sep 17 18:14:29.948218 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.948183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gth8h" event={"ID":"ac729035-33a8-4820-a49a-edd5e96875f6","Type":"ContainerStarted","Data":"8c7e5d860d396a801749ccdc41d7a2fc5bd97247dc06b845f870f7d4ff66e863"} Sep 17 18:14:29.950031 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.950007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" event={"ID":"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1","Type":"ContainerStarted","Data":"64e540131da054003c760efa1efedba48af9e5519d825089a4ed14e0412decf3"} Sep 17 18:14:29.950164 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.950050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" event={"ID":"dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1","Type":"ContainerStarted","Data":"9408b3fac10157565130fc5d82d16feebb106af4eb5a494a5fa507549739a0e2"} Sep 17 18:14:29.967129 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:29.967083 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-vwp8s" podStartSLOduration=2.808760383 podStartE2EDuration="3.967068729s" totalImagesPullingTime="1.158308346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:29.965493448 +0000 UTC m=+131.096963954" watchObservedRunningTime="2026-09-17 18:14:29.967068729 +0000 UTC m=+131.098539233" Sep 17 18:14:31.850250 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:31.850189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:31.959131 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:31.959091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gth8h" event={"ID":"ac729035-33a8-4820-a49a-edd5e96875f6","Type":"ContainerStarted","Data":"883e5e71dda5f99da47fbec45fe7094243eddd4d82a4f5710bf7a6e6c0713c2c"} Sep 17 18:14:31.959289 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:31.959143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gth8h" event={"ID":"ac729035-33a8-4820-a49a-edd5e96875f6","Type":"ContainerStarted","Data":"2e5ccb565357a6f92ec4307ab4e5a76d7eb650f0b99ef51ab5f9bf28c75c8909"} Sep 17 18:14:31.974266 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:31.974207 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gth8h" podStartSLOduration=131.736097669 podStartE2EDuration="2m12.974192711s" totalImagesPullingTime="1.238095042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:31.973832163 +0000 UTC m=+133.105302667" watchObservedRunningTime="2026-09-17 18:14:31.974192711 +0000 UTC m=+133.105663217" Sep 17 18:14:32.102455 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.102372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.128591 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.128553 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4"] Sep 17 18:14:32.130733 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.130711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.132900 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.132878 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 18:14:32.133221 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.133196 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nsb9m\"" Sep 17 18:14:32.133343 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.133260 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 18:14:32.148848 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.148825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4"] Sep 17 18:14:32.169100 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.169071 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vv498"] Sep 17 18:14:32.171236 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.171219 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.173263 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.173235 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 18:14:32.173263 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.173245 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7sbrc\"" Sep 17 18:14:32.173455 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.173240 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 18:14:32.173455 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.173351 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 18:14:32.198363 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.198339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.233221 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.233337 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-wtmp\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233337 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-metrics-client-ca\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233337 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233337 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-textfile\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233528 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-tls\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233528 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rd28\" (UniqueName: \"kubernetes.io/projected/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-kube-api-access-7rd28\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.233528 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-root\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233528 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.233728 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.233728 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-sys\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233728 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.233728 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.233657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtx65\" (UniqueName: \"kubernetes.io/projected/2e9403fe-79f4-4337-8207-687b290b9f1b-kube-api-access-jtx65\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.266286 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.266259 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.334179 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-sys\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtx65\" (UniqueName: \"kubernetes.io/projected/2e9403fe-79f4-4337-8207-687b290b9f1b-kube-api-access-jtx65\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-sys\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334345 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:32.334350 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-wtmp\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-metrics-client-ca\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:32.334417 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls podName:ddc5e295-a943-4b47-9ad3-68c81b4f65e0 nodeName:}" failed. No retries permitted until 2026-09-17 18:14:32.834398666 +0000 UTC m=+133.965869164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-hddr4" (UID: "ddc5e295-a943-4b47-9ad3-68c81b4f65e0") : secret "openshift-state-metrics-tls" not found Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-textfile\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-tls\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.334981 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.334588 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-wtmp\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.335124 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.335099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rd28\" (UniqueName: \"kubernetes.io/projected/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-kube-api-access-7rd28\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.335196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.335180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-root\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.335247 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.335203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-textfile\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.335801 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.335738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e9403fe-79f4-4337-8207-687b290b9f1b-root\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.336661 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.336450 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.336891 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.336723 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-accelerators-collector-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.338796 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.337012 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e9403fe-79f4-4337-8207-687b290b9f1b-metrics-client-ca\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.339332 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.339295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.341395 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.341375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.341491 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.341473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e9403fe-79f4-4337-8207-687b290b9f1b-node-exporter-tls\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.352802 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.352746 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtx65\" (UniqueName: \"kubernetes.io/projected/2e9403fe-79f4-4337-8207-687b290b9f1b-kube-api-access-jtx65\") pod \"node-exporter-vv498\" (UID: \"2e9403fe-79f4-4337-8207-687b290b9f1b\") " pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.352802 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.352787 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rd28\" (UniqueName: \"kubernetes.io/projected/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-kube-api-access-7rd28\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.372115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.372078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.462395 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.462364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.480974 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.480947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vv498" Sep 17 18:14:32.491993 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:32.491954 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9403fe_79f4_4337_8207_687b290b9f1b.slice/crio-60e001bbb8b4787a46bb991728a01c0396d7d311e5eb4ab96eb67a5c0f055389 WatchSource:0}: Error finding container 60e001bbb8b4787a46bb991728a01c0396d7d311e5eb4ab96eb67a5c0f055389: Status 404 returned error can't find the container with id 60e001bbb8b4787a46bb991728a01c0396d7d311e5eb4ab96eb67a5c0f055389 Sep 17 18:14:32.567901 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.567844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.664569 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.664437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.727685 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.727654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.838696 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.838663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.841185 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.841161 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddc5e295-a943-4b47-9ad3-68c81b4f65e0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-hddr4\" (UID: \"ddc5e295-a943-4b47-9ad3-68c81b4f65e0\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:32.866489 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.866466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:32.963773 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:32.963705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv498" event={"ID":"2e9403fe-79f4-4337-8207-687b290b9f1b","Type":"ContainerStarted","Data":"60e001bbb8b4787a46bb991728a01c0396d7d311e5eb4ab96eb67a5c0f055389"} Sep 17 18:14:33.006794 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.006724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.039938 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.039905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" Sep 17 18:14:33.114098 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.113657 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.207738 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.207701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.286000 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.285950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.333078 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.333052 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4"] Sep 17 18:14:33.349196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.349149 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.510007 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:33.509977 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc5e295_a943_4b47_9ad3_68c81b4f65e0.slice/crio-1b3363660d389199838d9c2f8b758b945ff12fedbf511ffbef1d8d37ff86a69c WatchSource:0}: Error finding container 1b3363660d389199838d9c2f8b758b945ff12fedbf511ffbef1d8d37ff86a69c: Status 404 returned error can't find the container with id 1b3363660d389199838d9c2f8b758b945ff12fedbf511ffbef1d8d37ff86a69c Sep 17 18:14:33.654772 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.654671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.755469 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.755440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:33.968682 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.968595 2579 generic.go:356] "Generic (PLEG): container finished" podID="2e9403fe-79f4-4337-8207-687b290b9f1b" containerID="17647bb55151483eae4fd133ee5fc3f53cc295b4e6afe2187e762b825e094f0f" exitCode=0 Sep 17 18:14:33.969116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.968678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv498" event={"ID":"2e9403fe-79f4-4337-8207-687b290b9f1b","Type":"ContainerDied","Data":"17647bb55151483eae4fd133ee5fc3f53cc295b4e6afe2187e762b825e094f0f"} Sep 17 18:14:33.970648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.970625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" event={"ID":"ddc5e295-a943-4b47-9ad3-68c81b4f65e0","Type":"ContainerStarted","Data":"2f94bdc765c4fbd2e2d69ba78fa93e6cc8f8cab544567b5a339e3bde3452e5af"} Sep 17 18:14:33.970751 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.970671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" event={"ID":"ddc5e295-a943-4b47-9ad3-68c81b4f65e0","Type":"ContainerStarted","Data":"d9fce299e3d504435d29abad035e37e328cad6810df359ea71f32ba25073f39b"} Sep 17 18:14:33.970751 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:33.970695 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" event={"ID":"ddc5e295-a943-4b47-9ad3-68c81b4f65e0","Type":"ContainerStarted","Data":"1b3363660d389199838d9c2f8b758b945ff12fedbf511ffbef1d8d37ff86a69c"} Sep 17 18:14:34.104494 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.104464 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-644546495-dccz4"] Sep 17 18:14:34.107084 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.107056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.109264 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 18:14:34.109398 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109303 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z2zj9\"" Sep 17 18:14:34.109398 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 18:14:34.109526 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109447 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-97lk7d5ldm1iv\"" Sep 17 18:14:34.109602 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 18:14:34.109668 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109610 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 18:14:34.109668 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.109644 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 18:14:34.118281 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.118258 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644546495-dccz4"] Sep 17 18:14:34.150074 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-grpc-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150074 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150251 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-metrics-client-ca\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150251 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150251 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150347 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150255 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150347 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sgjx\" (UniqueName: \"kubernetes.io/projected/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-kube-api-access-6sgjx\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.150347 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.150306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.251752 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.251664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.251752 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.251713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-metrics-client-ca\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.251955 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.251929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252017 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.251980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252073 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.252054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252129 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.252083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sgjx\" (UniqueName: \"kubernetes.io/projected/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-kube-api-access-6sgjx\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252129 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.252106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252225 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.252167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-grpc-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.252475 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.252445 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-metrics-client-ca\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.255904 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.255865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.256193 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.256021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.256193 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.256100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.256508 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.256486 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.257378 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.257353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-grpc-tls\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.258920 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.258899 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.262828 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.262810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sgjx\" (UniqueName: \"kubernetes.io/projected/be9bd5ac-7944-4d25-8f6a-55df8e6a515b-kube-api-access-6sgjx\") pod \"thanos-querier-644546495-dccz4\" (UID: \"be9bd5ac-7944-4d25-8f6a-55df8e6a515b\") " pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.272093 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.272058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:34.416967 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.416922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:34.474606 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.474480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:34.633275 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.633231 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:34.700189 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.700165 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-644546495-dccz4"] Sep 17 18:14:34.715597 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:34.715571 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9bd5ac_7944_4d25_8f6a_55df8e6a515b.slice/crio-74141409c434250af8b6adfd2e9ec7381b548302ee2c70adf59d50bcfa972dca WatchSource:0}: Error finding container 74141409c434250af8b6adfd2e9ec7381b548302ee2c70adf59d50bcfa972dca: Status 404 returned error can't find the container with id 74141409c434250af8b6adfd2e9ec7381b548302ee2c70adf59d50bcfa972dca Sep 17 18:14:34.976194 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.976093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" event={"ID":"ddc5e295-a943-4b47-9ad3-68c81b4f65e0","Type":"ContainerStarted","Data":"6d4419956e4e2b9968a274a8d1aa845c224d34df9aa40b85ca02f8fbdb7b6f03"} Sep 17 18:14:34.977532 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.977500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"74141409c434250af8b6adfd2e9ec7381b548302ee2c70adf59d50bcfa972dca"} Sep 17 18:14:34.979937 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.979916 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv498" event={"ID":"2e9403fe-79f4-4337-8207-687b290b9f1b","Type":"ContainerStarted","Data":"e37c726a75273637d82731480b6c0414c836aff37316285eb7eccee2215c7c4f"} Sep 17 18:14:34.980038 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.979953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vv498" event={"ID":"2e9403fe-79f4-4337-8207-687b290b9f1b","Type":"ContainerStarted","Data":"f8018046a515a0d0e60b5e8d058f9f654b18af1192f3b91eacb44bccfbeb2b9f"} Sep 17 18:14:34.993696 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:34.993653 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-hddr4" podStartSLOduration=1.977419877 podStartE2EDuration="2.993639319s" totalImagesPullingTime="1.016219442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:34.992756247 +0000 UTC m=+136.124226752" watchObservedRunningTime="2026-09-17 18:14:34.993639319 +0000 UTC m=+136.125109824" Sep 17 18:14:35.028434 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:35.028377 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vv498" podStartSLOduration=1.905854967 podStartE2EDuration="3.028355914s" totalImagesPullingTime="1.04430359s" totalInitContainerRuntime="78.197357ms" isStatefulPod=true podCreationTimestamp="2026-09-17 18:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:35.026837346 +0000 UTC m=+136.158307851" watchObservedRunningTime="2026-09-17 18:14:35.028355914 +0000 UTC m=+136.159826420" Sep 17 18:14:35.077474 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:35.077437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:35.140361 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:35.140332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:35.394994 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:35.394964 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:36.869599 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.869566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:36.882640 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.882593 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm"] Sep 17 18:14:36.885248 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.885224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:36.887509 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.887478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 18:14:36.887636 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.887594 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jbgqh\"" Sep 17 18:14:36.892960 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.892935 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm"] Sep 17 18:14:36.969562 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.969505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:36.975765 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.975738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:36.975918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:36.975775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8cl\" (UniqueName: \"kubernetes.io/projected/a5dd6384-1445-4a0d-ab3e-3b236001a79a-kube-api-access-rk8cl\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.077099 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.077064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.077266 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.077107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8cl\" (UniqueName: \"kubernetes.io/projected/a5dd6384-1445-4a0d-ab3e-3b236001a79a-kube-api-access-rk8cl\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.077266 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:37.077232 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 18:14:37.077385 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:37.077302 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert podName:a5dd6384-1445-4a0d-ab3e-3b236001a79a nodeName:}" failed. No retries permitted until 2026-09-17 18:14:37.577283474 +0000 UTC m=+138.708753971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-mhtlm" (UID: "a5dd6384-1445-4a0d-ab3e-3b236001a79a") : secret "monitoring-plugin-cert" not found Sep 17 18:14:37.088845 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.088815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8cl\" (UniqueName: \"kubernetes.io/projected/a5dd6384-1445-4a0d-ab3e-3b236001a79a-kube-api-access-rk8cl\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.267015 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.266990 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:37.451724 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.451693 2579 patch_prober.go:28] interesting pod/image-registry-86b64bfc9d-dfjpc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 18:14:37.451929 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.451739 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 18:14:37.579381 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.579349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.581882 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.581858 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a5dd6384-1445-4a0d-ab3e-3b236001a79a-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-mhtlm\" (UID: \"a5dd6384-1445-4a0d-ab3e-3b236001a79a\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.797605 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.797564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:37.993500 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.993466 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"5d393d3fc495ae67c127e0179761e7dd21ca698bf1669fad938e1a8ae3e7e047"} Sep 17 18:14:37.993875 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.993534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"6198900d0f7c081c23d14309cbbd4ecf4b9bdf0be36e82892e470ea2910fa3d8"} Sep 17 18:14:37.993875 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:37.993580 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"3b23785d83ebdd87f271a06986c905ab1c48fbd529f3990d5f1056ca83f4b657"} Sep 17 18:14:38.066201 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.066171 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm"] Sep 17 18:14:38.068826 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:38.068800 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5dd6384_1445_4a0d_ab3e_3b236001a79a.slice/crio-79a26fae3e9f25f5caece9dc9b2c8923b81816f43f278ffafa58151174dc842c WatchSource:0}: Error finding container 79a26fae3e9f25f5caece9dc9b2c8923b81816f43f278ffafa58151174dc842c: Status 404 returned error can't find the container with id 79a26fae3e9f25f5caece9dc9b2c8923b81816f43f278ffafa58151174dc842c Sep 17 18:14:38.362600 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.362521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:14:38.368426 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.368384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:38.371378 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.371347 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.373880 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374125 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374330 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374521 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374609 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374821 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5hr7g\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.374996 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b88be5l6anoqs\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.375066 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.375114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.375280 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.375306 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 18:14:38.375604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.375452 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 18:14:38.380769 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.380744 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 18:14:38.381330 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.381141 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 18:14:38.382640 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.382612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:14:38.485787 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.485957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.485957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.485957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.485957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.485999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qkv\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.486416 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.486322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587581 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587702 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587702 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587702 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587702 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.587903 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587909 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.587962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qkv\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588177 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.588848 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.588827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.589139 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.589115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.589214 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.589118 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.590119 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.589802 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.590204 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.590170 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.593957 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.593914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.594407 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.594381 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.595994 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.595970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.597179 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.596970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.597179 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.597119 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.598270 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.597518 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600399 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.599895 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600399 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600399 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600362 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600399 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600656 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600485 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600656 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600648 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.600864 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.600842 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.601643 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.601622 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qkv\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv\") pod \"prometheus-k8s-0\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.685759 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.685535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:38.983720 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:38.983645 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:14:38.987940 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:14:38.987907 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a951fd_913b_4655_8aa7_507c59eb6849.slice/crio-91a4614c03edcdb88d8a056ec0555ce4c7898f257afaa4ac96bcf3ee1a5a50a2 WatchSource:0}: Error finding container 91a4614c03edcdb88d8a056ec0555ce4c7898f257afaa4ac96bcf3ee1a5a50a2: Status 404 returned error can't find the container with id 91a4614c03edcdb88d8a056ec0555ce4c7898f257afaa4ac96bcf3ee1a5a50a2 Sep 17 18:14:39.001466 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.001247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"d0c8b1acfa4426522b18fcca07b72d38b024ef389028f87f2761f4173dfdaff3"} Sep 17 18:14:39.001466 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.001331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"81f775b340ef496bee60dfef3c114f9cde86b2383011dbc494375021b17b546e"} Sep 17 18:14:39.001466 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.001376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-644546495-dccz4" event={"ID":"be9bd5ac-7944-4d25-8f6a-55df8e6a515b","Type":"ContainerStarted","Data":"af62a1ba23a76e2fb8cae740073ae4700379897ca1fbcd9c6816e151b5aa29d6"} Sep 17 18:14:39.001466 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.001420 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:39.002596 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.002568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"91a4614c03edcdb88d8a056ec0555ce4c7898f257afaa4ac96bcf3ee1a5a50a2"} Sep 17 18:14:39.004081 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.004059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" event={"ID":"a5dd6384-1445-4a0d-ab3e-3b236001a79a","Type":"ContainerStarted","Data":"79a26fae3e9f25f5caece9dc9b2c8923b81816f43f278ffafa58151174dc842c"} Sep 17 18:14:39.025747 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:39.025701 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-644546495-dccz4" podStartSLOduration=1.415561083 podStartE2EDuration="5.02568652s" totalImagesPullingTime="3.610125437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:39.024399125 +0000 UTC m=+140.155869630" watchObservedRunningTime="2026-09-17 18:14:39.02568652 +0000 UTC m=+140.157157025" Sep 17 18:14:41.013199 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.013164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" event={"ID":"a5dd6384-1445-4a0d-ab3e-3b236001a79a","Type":"ContainerStarted","Data":"e959b8f74b09024976a6661fbc2b160da55766d3971fab29f9ecf741cf132a12"} Sep 17 18:14:41.013644 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.013335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:41.014929 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.014906 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" exitCode=0 Sep 17 18:14:41.015022 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.014935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} Sep 17 18:14:41.018575 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.018554 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" Sep 17 18:14:41.027878 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:41.027838 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-mhtlm" podStartSLOduration=3.028293003 podStartE2EDuration="5.027823151s" totalImagesPullingTime="1.999530148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:41.027636631 +0000 UTC m=+142.159107140" watchObservedRunningTime="2026-09-17 18:14:41.027823151 +0000 UTC m=+142.159293657" Sep 17 18:14:42.465150 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.465100 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" containerID="cri-o://73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3" gracePeriod=30 Sep 17 18:14:42.710314 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.710291 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:42.823994 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.823962 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824155 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824007 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824155 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdbkd\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824155 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824087 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824155 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824120 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824155 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824143 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824196 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") pod \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\" (UID: \"4e5f94c1-7105-45e3-99d6-70ff0f7bb806\") " Sep 17 18:14:42.824610 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.824582 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:14:42.825599 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.825530 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:14:42.827207 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.827114 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:14:42.827207 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.827115 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:14:42.827207 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.827171 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:14:42.828191 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.828167 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd" (OuterVolumeSpecName: "kube-api-access-tdbkd") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "kube-api-access-tdbkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:14:42.828295 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.828165 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:14:42.834611 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.834587 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e5f94c1-7105-45e3-99d6-70ff0f7bb806" (UID: "4e5f94c1-7105-45e3-99d6-70ff0f7bb806"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:14:42.927116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927084 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-certificates\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927111 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-registry-tls\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927121 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-bound-sa-token\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927128 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-trusted-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927136 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdbkd\" (UniqueName: \"kubernetes.io/projected/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-kube-api-access-tdbkd\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927151 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-image-registry-private-configuration\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927165 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-ca-trust-extracted\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:42.927394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:42.927176 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e5f94c1-7105-45e3-99d6-70ff0f7bb806-installation-pull-secrets\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:14:43.024746 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.024709 2579 generic.go:356] "Generic (PLEG): container finished" podID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerID="73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3" exitCode=0 Sep 17 18:14:43.024909 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.024789 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" Sep 17 18:14:43.024909 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.024798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" event={"ID":"4e5f94c1-7105-45e3-99d6-70ff0f7bb806","Type":"ContainerDied","Data":"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3"} Sep 17 18:14:43.024909 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.024892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b64bfc9d-dfjpc" event={"ID":"4e5f94c1-7105-45e3-99d6-70ff0f7bb806","Type":"ContainerDied","Data":"89a4354e59a1e4d7864f42109f45d58de5afb9a551cb223e8e36f4d7382fa365"} Sep 17 18:14:43.025062 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.024919 2579 scope.go:117] "RemoveContainer" containerID="73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3" Sep 17 18:14:43.035668 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.035651 2579 scope.go:117] "RemoveContainer" containerID="73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3" Sep 17 18:14:43.036383 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:43.036354 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3\": container with ID starting with 73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3 not found: ID does not exist" containerID="73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3" Sep 17 18:14:43.036467 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.036394 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3"} err="failed to get container status \"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3\": rpc error: code = NotFound desc = could not find container \"73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3\": container with ID starting with 73d2e021c27eff8ade7dfeb8258c3b04dbdd8d4b1e017d9b71faab4981f3ecd3 not found: ID does not exist" Sep 17 18:14:43.049886 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.049855 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:14:43.053435 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.053413 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86b64bfc9d-dfjpc"] Sep 17 18:14:43.378460 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:43.378115 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" path="/var/lib/kubelet/pods/4e5f94c1-7105-45e3-99d6-70ff0f7bb806/volumes" Sep 17 18:14:45.014772 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:45.014732 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-644546495-dccz4" Sep 17 18:14:46.041136 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} Sep 17 18:14:46.041492 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} Sep 17 18:14:46.041492 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} Sep 17 18:14:46.041492 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} Sep 17 18:14:46.041492 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} Sep 17 18:14:46.041492 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.041289 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerStarted","Data":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} Sep 17 18:14:46.068256 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:46.068207 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.783218646 podStartE2EDuration="8.068192262s" totalImagesPullingTime="5.265285961s" totalInitContainerRuntime="19.687655ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:14:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:14:46.067194503 +0000 UTC m=+147.198665010" watchObservedRunningTime="2026-09-17 18:14:46.068192262 +0000 UTC m=+147.199662766" Sep 17 18:14:47.682591 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:47.682531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:47.737856 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:47.737819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:48.686460 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:48.686414 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:14:51.563974 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:51.563919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:51.706468 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:51.706433 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:52.159872 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:52.159840 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:52.259737 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:52.259700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:54.734300 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:54.734268 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:54.834707 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:54.834673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:54.935508 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:54.935479 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:56.216023 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:14:56.215981 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-86sxm" podUID="b6dd2186-5502-43a2-87a7-4408ba3a80e9" Sep 17 18:14:57.083436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:57.083408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86sxm" Sep 17 18:14:59.489187 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:59.489154 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:14:59.545989 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:14:59.545959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:00.519471 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:00.519435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:00.587183 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:00.587150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:00.900261 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:00.900161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:01.105169 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:01.105140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:15:01.107513 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:01.107491 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b6dd2186-5502-43a2-87a7-4408ba3a80e9-metrics-tls\") pod \"dns-default-86sxm\" (UID: \"b6dd2186-5502-43a2-87a7-4408ba3a80e9\") " pod="openshift-dns/dns-default-86sxm" Sep 17 18:15:01.285862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:01.285840 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zvj69\"" Sep 17 18:15:01.294361 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:01.294340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86sxm" Sep 17 18:15:01.568901 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:01.568879 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86sxm"] Sep 17 18:15:01.571054 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:15:01.571026 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dd2186_5502_43a2_87a7_4408ba3a80e9.slice/crio-4d3d8f472fdd18f2228ea9d4d7a2c1a96882f0fc51fb5956e6524a2532bdbab1 WatchSource:0}: Error finding container 4d3d8f472fdd18f2228ea9d4d7a2c1a96882f0fc51fb5956e6524a2532bdbab1: Status 404 returned error can't find the container with id 4d3d8f472fdd18f2228ea9d4d7a2c1a96882f0fc51fb5956e6524a2532bdbab1 Sep 17 18:15:02.104314 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:02.104276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86sxm" event={"ID":"b6dd2186-5502-43a2-87a7-4408ba3a80e9","Type":"ContainerStarted","Data":"4d3d8f472fdd18f2228ea9d4d7a2c1a96882f0fc51fb5956e6524a2532bdbab1"} Sep 17 18:15:02.643708 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:02.643671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:02.705471 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:02.705437 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:03.125185 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:03.125150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:03.225650 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:03.225617 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:04.114917 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:04.114880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86sxm" event={"ID":"b6dd2186-5502-43a2-87a7-4408ba3a80e9","Type":"ContainerStarted","Data":"412efecc8207aa2f12425b3b7b5013c8e3e926485ace0d99f996419fd47d1fb2"} Sep 17 18:15:04.115336 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:04.114940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86sxm" event={"ID":"b6dd2186-5502-43a2-87a7-4408ba3a80e9","Type":"ContainerStarted","Data":"2750a1234259932fe9ce610ed59a1d17fc974c781945d1bf5b0d6a1d1c77821c"} Sep 17 18:15:04.115336 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:04.114970 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-86sxm" Sep 17 18:15:04.132793 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:04.132736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-86sxm" podStartSLOduration=129.324058576 podStartE2EDuration="2m11.132716295s" totalImagesPullingTime="1.808657719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:15:04.131618409 +0000 UTC m=+165.263088913" watchObservedRunningTime="2026-09-17 18:15:04.132716295 +0000 UTC m=+165.264186801" Sep 17 18:15:07.957871 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:07.957836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:08.064115 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:08.064058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:08.623081 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:08.623047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:08.686228 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:08.686185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:12.256421 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:12.256336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:12.353898 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:12.353867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:12.455440 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:12.455406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:14.121810 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:14.121782 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-86sxm" Sep 17 18:15:17.728490 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:17.728424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:17.824647 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:17.824607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:21.183114 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:21.183079 2579 generic.go:356] "Generic (PLEG): container finished" podID="eec0c70b-d7aa-4c2b-933b-9f630ea4411f" containerID="1366a8b9444abffb2897d8989a024349b5d9f5eaa874b4b170394f74abc79cb5" exitCode=0 Sep 17 18:15:21.183510 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:21.183129 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" event={"ID":"eec0c70b-d7aa-4c2b-933b-9f630ea4411f","Type":"ContainerDied","Data":"1366a8b9444abffb2897d8989a024349b5d9f5eaa874b4b170394f74abc79cb5"} Sep 17 18:15:21.183510 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:21.183439 2579 scope.go:117] "RemoveContainer" containerID="1366a8b9444abffb2897d8989a024349b5d9f5eaa874b4b170394f74abc79cb5" Sep 17 18:15:22.188700 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:22.188667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b4lfg" event={"ID":"eec0c70b-d7aa-4c2b-933b-9f630ea4411f","Type":"ContainerStarted","Data":"a26dc3e5b728782a4b6f59c7aa1dcab1be29768be0a60c0eb5a114d5061892e0"} Sep 17 18:15:23.329760 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:23.329728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:23.431946 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:23.431916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:25.496673 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:25.496638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:25.597720 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:25.597688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:27.243502 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:27.243473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:27.303953 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:27.303923 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:32.667790 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:32.667752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:38.686161 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:38.686126 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:38.706764 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:38.706736 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:39.273795 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:39.273753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:42.289838 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:42.289805 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:42.386012 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:42.385982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:46.499718 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:46.499668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:46.559778 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:46.559717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:51.354939 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:51.354892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:51.584271 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:51.584236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:15:56.745788 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.745748 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:56.747044 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.746990 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="prometheus" containerID="cri-o://8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" gracePeriod=600 Sep 17 18:15:56.747210 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.747161 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" gracePeriod=600 Sep 17 18:15:56.747340 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.747246 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-web" containerID="cri-o://e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" gracePeriod=600 Sep 17 18:15:56.747340 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.747331 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy" containerID="cri-o://d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" gracePeriod=600 Sep 17 18:15:56.747450 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.747405 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="thanos-sidecar" containerID="cri-o://29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" gracePeriod=600 Sep 17 18:15:56.747502 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.747481 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="config-reloader" containerID="cri-o://cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" gracePeriod=600 Sep 17 18:15:56.993188 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:56.993159 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.066714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066678 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066714 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066725 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4qkv\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066763 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066793 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066824 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066852 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066906 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.066969 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066960 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.066985 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067015 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067047 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067061 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067082 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067114 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067139 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067191 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067215 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067287 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config\") pod \"18a951fd-913b-4655-8aa7-507c59eb6849\" (UID: \"18a951fd-913b-4655-8aa7-507c59eb6849\") " Sep 17 18:15:57.067382 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067343 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.068003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067418 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.068003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067575 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.068003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067598 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.068003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067613 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.068003 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.067905 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.068243 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.068152 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.068880 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.068849 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.070277 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.069519 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 18:15:57.070277 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.069858 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:15:57.071691 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.071655 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config" (OuterVolumeSpecName: "config") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074518 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074313 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:15:57.074518 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074494 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out" (OuterVolumeSpecName: "config-out") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 18:15:57.074703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074665 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074703 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074682 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074803 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074727 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074803 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074747 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074803 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074763 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.074803 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074760 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv" (OuterVolumeSpecName: "kube-api-access-b4qkv") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "kube-api-access-b4qkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 18:15:57.075082 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.074870 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.076605 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.076579 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.085670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.085649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config" (OuterVolumeSpecName: "web-config") pod "18a951fd-913b-4655-8aa7-507c59eb6849" (UID: "18a951fd-913b-4655-8aa7-507c59eb6849"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 18:15:57.168196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168163 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-web-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168196 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168193 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168204 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-tls-assets\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168214 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-metrics-client-certs\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168223 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168232 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-db\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168240 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-grpc-tls\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168248 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-config\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168256 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4qkv\" (UniqueName: \"kubernetes.io/projected/18a951fd-913b-4655-8aa7-507c59eb6849-kube-api-access-b4qkv\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168263 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168272 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168281 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168288 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a951fd-913b-4655-8aa7-507c59eb6849-config-out\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168296 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-kube-rbac-proxy\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168304 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168313 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a951fd-913b-4655-8aa7-507c59eb6849-configmap-metrics-client-ca\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.168354 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.168321 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a951fd-913b-4655-8aa7-507c59eb6849-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-166.ec2.internal\" DevicePath \"\"" Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332023 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332049 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332055 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332060 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332065 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332070 2579 generic.go:356] "Generic (PLEG): container finished" podID="18a951fd-913b-4655-8aa7-507c59eb6849" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" exitCode=0 Sep 17 18:15:57.332101 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332099 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332332 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} Sep 17 18:15:57.332436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a951fd-913b-4655-8aa7-507c59eb6849","Type":"ContainerDied","Data":"91a4614c03edcdb88d8a056ec0555ce4c7898f257afaa4ac96bcf3ee1a5a50a2"} Sep 17 18:15:57.333089 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.332253 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.340983 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.340967 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.348562 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.348524 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.354732 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.354712 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:57.355627 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.355606 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.358995 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.358976 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:57.362587 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.362570 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.369197 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.369181 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.376143 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.376116 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" path="/var/lib/kubelet/pods/18a951fd-913b-4655-8aa7-507c59eb6849/volumes" Sep 17 18:15:57.376801 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.376787 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.383501 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.383439 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.383977 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.383857 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.383977 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.383937 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.383977 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.383964 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.384277 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.384257 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.384333 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384289 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.384333 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384309 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.384584 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.384565 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.384634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384593 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.384634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384613 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.384923 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.384905 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.384998 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384932 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.384998 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.384952 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.385233 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.385217 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.385283 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385237 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.385283 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385250 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.385368 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385295 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:57.385502 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.385486 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.385576 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385509 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.385576 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385528 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385616 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="config-reloader" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385629 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="config-reloader" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385639 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385645 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385656 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="init-config-reloader" Sep 17 18:15:57.385670 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385663 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="init-config-reloader" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385674 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385681 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385694 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="prometheus" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385702 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="prometheus" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385714 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="thanos-sidecar" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385720 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="thanos-sidecar" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385731 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-web" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385736 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-web" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385745 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-thanos" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385750 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-thanos" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385795 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5f94c1-7105-45e3-99d6-70ff0f7bb806" containerName="registry" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385804 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="prometheus" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385809 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-thanos" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: E0917 18:15:57.385807 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385829 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.385844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385842 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385814 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="thanos-sidecar" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385892 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="config-reloader" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385901 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.385907 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a951fd-913b-4655-8aa7-507c59eb6849" containerName="kube-rbac-proxy-web" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386077 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386094 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386311 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.386430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386328 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.386904 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386612 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.386904 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386634 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.387011 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386923 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.387011 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.386945 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.387274 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387256 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.387363 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387276 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.387595 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387574 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.387595 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387595 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.387876 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387857 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.387921 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.387877 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.388124 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388107 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.388190 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388126 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.388352 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388334 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.388396 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388352 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.388587 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388569 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.388644 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388588 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.388816 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388801 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.388861 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.388816 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.389044 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389021 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.389109 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389046 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.389256 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389240 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.389303 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389257 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.389483 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389464 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.389581 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389484 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.389736 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389721 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.389777 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389736 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.389955 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389937 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.389993 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.389956 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.390026 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.390472 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390198 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.390472 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390223 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.390676 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390649 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.390774 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390677 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.390975 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.391034 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.390977 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.391243 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.391222 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.391310 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.391247 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.391784 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.391658 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.391784 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.391701 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.392376 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.392183 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.392376 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.392206 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.393271 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393084 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.393271 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393108 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.393666 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393647 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 18:15:57.393666 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393662 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.393844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393687 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.393908 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 18:15:57.393961 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 18:15:57.394023 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393953 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.394023 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.393972 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.394153 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 18:15:57.394153 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 18:15:57.394274 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394229 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.394274 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394255 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.394389 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394355 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 18:15:57.394450 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 18:15:57.394502 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394476 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5hr7g\"" Sep 17 18:15:57.394604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394499 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.394604 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394520 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.394743 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394614 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 18:15:57.394743 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394632 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 18:15:57.394743 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394682 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b88be5l6anoqs\"" Sep 17 18:15:57.394889 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394808 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 18:15:57.394968 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.395104 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.394973 2579 scope.go:117] "RemoveContainer" containerID="e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682" Sep 17 18:15:57.395104 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 18:15:57.395214 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 18:15:57.395260 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395226 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 18:15:57.395317 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395282 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682"} err="failed to get container status \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": rpc error: code = NotFound desc = could not find container \"e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682\": container with ID starting with e30f9856ca0e4fd5b1873661c726b2a658d6f1cebde774747e1e4633041f8682 not found: ID does not exist" Sep 17 18:15:57.395317 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395302 2579 scope.go:117] "RemoveContainer" containerID="d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea" Sep 17 18:15:57.395601 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395573 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea"} err="failed to get container status \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": rpc error: code = NotFound desc = could not find container \"d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea\": container with ID starting with d04ca0390003df015ce778770eb4b23b3f1e34d476493a08677caf90d20ab6ea not found: ID does not exist" Sep 17 18:15:57.395689 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395602 2579 scope.go:117] "RemoveContainer" containerID="e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7" Sep 17 18:15:57.395895 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395866 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7"} err="failed to get container status \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": rpc error: code = NotFound desc = could not find container \"e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7\": container with ID starting with e58dc7ff743f15cdeaf6df14cdc25f5b2ddfd4ee74fc137d985bf3ef98635da7 not found: ID does not exist" Sep 17 18:15:57.395895 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.395893 2579 scope.go:117] "RemoveContainer" containerID="29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67" Sep 17 18:15:57.396154 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396135 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67"} err="failed to get container status \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": rpc error: code = NotFound desc = could not find container \"29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67\": container with ID starting with 29adc905cbbcf976f8658e9f442da3c71b6aa5f5722bf2f2a2e74f8cdbbbfa67 not found: ID does not exist" Sep 17 18:15:57.396154 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396152 2579 scope.go:117] "RemoveContainer" containerID="cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc" Sep 17 18:15:57.396413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396392 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc"} err="failed to get container status \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": rpc error: code = NotFound desc = could not find container \"cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc\": container with ID starting with cb6d300dd0e9b36a81c34fdbbc5edc0dffe9e1b42947a463f0d857baeae1d1cc not found: ID does not exist" Sep 17 18:15:57.396413 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396413 2579 scope.go:117] "RemoveContainer" containerID="8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426" Sep 17 18:15:57.396681 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396663 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426"} err="failed to get container status \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": rpc error: code = NotFound desc = could not find container \"8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426\": container with ID starting with 8d7e482a5e407682a55366adecf2c29a3c59fb1fad1e90e6e32160d3c8a4e426 not found: ID does not exist" Sep 17 18:15:57.396740 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396682 2579 scope.go:117] "RemoveContainer" containerID="9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6" Sep 17 18:15:57.396832 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 18:15:57.396965 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.396947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6"} err="failed to get container status \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": rpc error: code = NotFound desc = could not find container \"9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6\": container with ID starting with 9076d468de6f55dd0075cc5e765052343cbecc9da0eb09ef99488d06088a6ff6 not found: ID does not exist" Sep 17 18:15:57.400385 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.400362 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 18:15:57.408260 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.408230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:57.470656 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470656 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470658 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.470862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.470984 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471069 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471049 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hsz\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-kube-api-access-f7hsz\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471296 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471296 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471296 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.471296 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.471139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571873 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571755 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571873 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571873 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571873 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.571873 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571944 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.571986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hsz\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-kube-api-access-f7hsz\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572133 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572170 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.572862 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.572813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.573346 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.573319 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.574998 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.574248 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.574998 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.574917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.576679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.575682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.576679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.575880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.576679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.576372 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.576679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.576504 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.576679 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.576647 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.576822 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.576906 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577046 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577436 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.577750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.577732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.578198 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.578178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.578403 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.578387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-config\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.583504 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.583459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hsz\" (UniqueName: \"kubernetes.io/projected/4f38cbd7-eff3-4971-90a5-f7d5afa93e58-kube-api-access-f7hsz\") pod \"prometheus-k8s-0\" (UID: \"4f38cbd7-eff3-4971-90a5-f7d5afa93e58\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.701365 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.701334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:15:57.981587 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:57.981489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 18:15:57.986010 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:15:57.985985 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f38cbd7_eff3_4971_90a5_f7d5afa93e58.slice/crio-a8a8ec3faa9cf37d36b40030b841bdc9c6785bab1f14b9fe297df9f3318348f5 WatchSource:0}: Error finding container a8a8ec3faa9cf37d36b40030b841bdc9c6785bab1f14b9fe297df9f3318348f5: Status 404 returned error can't find the container with id a8a8ec3faa9cf37d36b40030b841bdc9c6785bab1f14b9fe297df9f3318348f5 Sep 17 18:15:58.338738 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:58.338705 2579 generic.go:356] "Generic (PLEG): container finished" podID="4f38cbd7-eff3-4971-90a5-f7d5afa93e58" containerID="e567f065598c2ac42fefc8ca295f1a9f0b90009b2b1d6552604f03c0b1c524f4" exitCode=0 Sep 17 18:15:58.339008 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:58.338748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerDied","Data":"e567f065598c2ac42fefc8ca295f1a9f0b90009b2b1d6552604f03c0b1c524f4"} Sep 17 18:15:58.339008 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:58.338800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"a8a8ec3faa9cf37d36b40030b841bdc9c6785bab1f14b9fe297df9f3318348f5"} Sep 17 18:15:59.346479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"405829b80a7d8f8337cf5cc3d8ea777de11270fab16929bcdaecab62dcf1cbe7"} Sep 17 18:15:59.346885 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"8f2c93b88c47f92a9e289b463117f62e20dd11d5bbbf14ebfb681d962fcd2f1f"} Sep 17 18:15:59.346885 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346589 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"428b7dd056185be275216c7692805e7a7c8ee9f811ed7e481d05c90bc0569200"} Sep 17 18:15:59.346885 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"13e1844fab8944ec6cd15768564c43bc2c8e9473a3cbd97fdca65a7ba0ad0f16"} Sep 17 18:15:59.346885 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"d03500129922f1ec77bcee1d61d614e13991671e9ef3539026f2978c910e15c8"} Sep 17 18:15:59.346885 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.346670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f38cbd7-eff3-4971-90a5-f7d5afa93e58","Type":"ContainerStarted","Data":"e994ce4ba3b3a604f2994c01cf79ddebcf5888d53ff4678e2a5f0a85b27f386b"} Sep 17 18:15:59.374835 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:15:59.374779 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.355741813 podStartE2EDuration="2.374758347s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.016534ms" isStatefulPod=false podCreationTimestamp="2026-09-17 18:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:15:59.372189194 +0000 UTC m=+220.503659716" watchObservedRunningTime="2026-09-17 18:15:59.374758347 +0000 UTC m=+220.506228852" Sep 17 18:16:00.689884 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:00.689850 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:01.979420 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:01.979385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:02.701702 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:02.701660 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:16:09.810564 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:09.810512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:09.867097 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:09.867066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:11.894142 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:11.894113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:11.994479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:11.994441 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:12.096966 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:12.096932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:12.161696 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:12.161615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:12.247691 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:12.247654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:12.310384 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:12.310356 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:16:57.702453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:57.702413 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:16:57.718451 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:57.718427 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:16:58.580726 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:16:58.580699 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 18:17:06.570273 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:06.570235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:06.627008 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:06.626971 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:18.401346 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:18.401300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:18.462273 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:18.462239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:19.259955 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:19.259930 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 18:17:27.268499 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:27.268458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:27.369676 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:27.369646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:29.146513 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:29.146484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:17:29.200449 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:17:29.200419 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:18:00.900933 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:00.900903 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:18:04.298776 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:04.298716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:18:04.357390 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:04.357360 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" limit=1024 Sep 17 18:18:07.051725 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:07.051695 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-clwkx_153d2612-ba28-4f30-9aec-64e7d3afc04d/global-pull-secret-syncer/0.log" Sep 17 18:18:07.150307 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:07.150274 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2d7wq_325e253d-faeb-432d-acec-d719f96ddd02/konnectivity-agent/0.log" Sep 17 18:18:07.290640 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:07.290616 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-166.ec2.internal_b3f900471a2071921a644d61a817625b/haproxy/0.log" Sep 17 18:18:10.900046 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:10.900017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-xnnrh_a5fbe798-f193-4d7c-ba0a-edcbb8c3e258/cluster-monitoring-operator/0.log" Sep 17 18:18:11.043812 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.043782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-mhtlm_a5dd6384-1445-4a0d-ab3e-3b236001a79a/monitoring-plugin/0.log" Sep 17 18:18:11.241901 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.241823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv498_2e9403fe-79f4-4337-8207-687b290b9f1b/node-exporter/0.log" Sep 17 18:18:11.267342 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.267323 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv498_2e9403fe-79f4-4337-8207-687b290b9f1b/kube-rbac-proxy/0.log" Sep 17 18:18:11.291690 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.291670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vv498_2e9403fe-79f4-4337-8207-687b290b9f1b/init-textfile/0.log" Sep 17 18:18:11.319495 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.319475 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hddr4_ddc5e295-a943-4b47-9ad3-68c81b4f65e0/kube-rbac-proxy-main/0.log" Sep 17 18:18:11.345042 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.345022 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hddr4_ddc5e295-a943-4b47-9ad3-68c81b4f65e0/kube-rbac-proxy-self/0.log" Sep 17 18:18:11.374193 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.374166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-hddr4_ddc5e295-a943-4b47-9ad3-68c81b4f65e0/openshift-state-metrics/0.log" Sep 17 18:18:11.416135 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.416111 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/prometheus/0.log" Sep 17 18:18:11.438514 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.438484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/config-reloader/0.log" Sep 17 18:18:11.463287 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.463260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/thanos-sidecar/0.log" Sep 17 18:18:11.486910 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.486888 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/kube-rbac-proxy-web/0.log" Sep 17 18:18:11.510918 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.510898 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/kube-rbac-proxy/0.log" Sep 17 18:18:11.535641 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.535623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/kube-rbac-proxy-thanos/0.log" Sep 17 18:18:11.564225 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.564206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f38cbd7-eff3-4971-90a5-f7d5afa93e58/init-config-reloader/0.log" Sep 17 18:18:11.590870 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.590845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-vwp8s_dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1/prometheus-operator/0.log" Sep 17 18:18:11.612446 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.612424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-vwp8s_dcc0fcd4-7b54-412b-ad8d-b4eb14f16ce1/kube-rbac-proxy/0.log" Sep 17 18:18:11.639625 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.639607 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-bfckc_b22cc4f1-7732-4d03-80a3-20d5f80d0e4e/prometheus-operator-admission-webhook/0.log" Sep 17 18:18:11.744612 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.744583 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/thanos-query/0.log" Sep 17 18:18:11.768185 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.768122 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/kube-rbac-proxy-web/0.log" Sep 17 18:18:11.791648 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.791624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/kube-rbac-proxy/0.log" Sep 17 18:18:11.818086 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.818062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/prom-label-proxy/0.log" Sep 17 18:18:11.848634 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.848609 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/kube-rbac-proxy-rules/0.log" Sep 17 18:18:11.870980 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:11.870956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-644546495-dccz4_be9bd5ac-7944-4d25-8f6a-55df8e6a515b/kube-rbac-proxy-metrics/0.log" Sep 17 18:18:14.413682 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.413652 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-4mr2l_eeeee892-275f-4d78-8ca6-acb6de23642c/volume-data-source-validator/0.log" Sep 17 18:18:14.441614 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.441588 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842"] Sep 17 18:18:14.444976 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.444950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.446962 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.446942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mlf2\"/\"openshift-service-ca.crt\"" Sep 17 18:18:14.447565 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.447530 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7mlf2\"/\"default-dockercfg-smbf8\"" Sep 17 18:18:14.447664 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.447532 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7mlf2\"/\"kube-root-ca.crt\"" Sep 17 18:18:14.451927 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.451907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842"] Sep 17 18:18:14.567680 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.567645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-podres\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.567680 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.567687 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-sys\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.567908 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.567703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-proc\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.567908 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.567731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-lib-modules\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.567908 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.567751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmrr\" (UniqueName: \"kubernetes.io/projected/510c0be7-bf0a-4921-96f1-b58f45113bda-kube-api-access-5lmrr\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668295 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-podres\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668295 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668258 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-sys\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668295 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-proc\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-lib-modules\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmrr\" (UniqueName: \"kubernetes.io/projected/510c0be7-bf0a-4921-96f1-b58f45113bda-kube-api-access-5lmrr\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668360 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-sys\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-proc\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-podres\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.668479 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.668472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/510c0be7-bf0a-4921-96f1-b58f45113bda-lib-modules\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.676715 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.676692 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmrr\" (UniqueName: \"kubernetes.io/projected/510c0be7-bf0a-4921-96f1-b58f45113bda-kube-api-access-5lmrr\") pod \"perf-node-gather-daemonset-fs842\" (UID: \"510c0be7-bf0a-4921-96f1-b58f45113bda\") " pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:14.755346 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:14.755312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:15.024872 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.024814 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842"] Sep 17 18:18:15.027158 ip-10-0-137-166 kubenswrapper[2579]: W0917 18:18:15.027125 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod510c0be7_bf0a_4921_96f1_b58f45113bda.slice/crio-d89974b8539efee012c4f71e0c8160c1dea1b067264ca3f0b0b2eb0aa9ba5ac5 WatchSource:0}: Error finding container d89974b8539efee012c4f71e0c8160c1dea1b067264ca3f0b0b2eb0aa9ba5ac5: Status 404 returned error can't find the container with id d89974b8539efee012c4f71e0c8160c1dea1b067264ca3f0b0b2eb0aa9ba5ac5 Sep 17 18:18:15.252370 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.252345 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86sxm_b6dd2186-5502-43a2-87a7-4408ba3a80e9/dns/0.log" Sep 17 18:18:15.273409 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.273385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86sxm_b6dd2186-5502-43a2-87a7-4408ba3a80e9/kube-rbac-proxy/0.log" Sep 17 18:18:15.360784 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.360709 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnvbj_7b548676-bb64-40f1-af2b-8c2c84d15ab4/dns-node-resolver/0.log" Sep 17 18:18:15.804430 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.804405 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2fpd_0f40bddb-54de-4f40-bf34-1b232eddd4e4/node-ca/0.log" Sep 17 18:18:15.853585 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.853534 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" event={"ID":"510c0be7-bf0a-4921-96f1-b58f45113bda","Type":"ContainerStarted","Data":"80f0a71611981e1b87a2a25ef64c40340fe3203ff491ed79448ca187edc0c8bf"} Sep 17 18:18:15.853738 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.853604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" event={"ID":"510c0be7-bf0a-4921-96f1-b58f45113bda","Type":"ContainerStarted","Data":"d89974b8539efee012c4f71e0c8160c1dea1b067264ca3f0b0b2eb0aa9ba5ac5"} Sep 17 18:18:15.853738 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.853680 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:15.869411 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:15.869369 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" podStartSLOduration=1.8693555210000001 podStartE2EDuration="1.869355521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:18:15.867930454 +0000 UTC m=+356.999400969" watchObservedRunningTime="2026-09-17 18:18:15.869355521 +0000 UTC m=+357.000826025" Sep 17 18:18:16.818356 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:16.818326 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bncbx_4316ca47-2fc4-4a59-aa9d-715ec791ad6c/serve-healthcheck-canary/0.log" Sep 17 18:18:17.327331 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:17.327301 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjfk9_ce88d485-0ae2-4abd-ac63-21d1d3397b6a/kube-rbac-proxy/0.log" Sep 17 18:18:17.348869 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:17.348844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjfk9_ce88d485-0ae2-4abd-ac63-21d1d3397b6a/exporter/0.log" Sep 17 18:18:17.370356 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:17.370331 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rjfk9_ce88d485-0ae2-4abd-ac63-21d1d3397b6a/extractor/0.log" Sep 17 18:18:21.357339 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:21.357302 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-b4lfg_eec0c70b-d7aa-4c2b-933b-9f630ea4411f/kube-storage-version-migrator-operator/1.log" Sep 17 18:18:21.358334 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:21.358317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-b4lfg_eec0c70b-d7aa-4c2b-933b-9f630ea4411f/kube-storage-version-migrator-operator/0.log" Sep 17 18:18:21.867333 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:21.867304 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7mlf2/perf-node-gather-daemonset-fs842" Sep 17 18:18:22.450079 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.450055 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/kube-multus-additional-cni-plugins/0.log" Sep 17 18:18:22.474836 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.474813 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/egress-router-binary-copy/0.log" Sep 17 18:18:22.498517 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.498494 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/cni-plugins/0.log" Sep 17 18:18:22.522482 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.522459 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/bond-cni-plugin/0.log" Sep 17 18:18:22.546138 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.546110 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/routeoverride-cni/0.log" Sep 17 18:18:22.568993 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.568970 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/whereabouts-cni-bincopy/0.log" Sep 17 18:18:22.591826 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.591804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qmdf2_76e2edb4-629e-4837-acfd-633370c1a1f3/whereabouts-cni/0.log" Sep 17 18:18:22.649227 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.649200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pm2pg_41f9e773-950c-44fe-a1d5-fdd69d9de507/kube-multus/0.log" Sep 17 18:18:22.727844 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.727775 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gth8h_ac729035-33a8-4820-a49a-edd5e96875f6/network-metrics-daemon/0.log" Sep 17 18:18:22.749116 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:22.749095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gth8h_ac729035-33a8-4820-a49a-edd5e96875f6/kube-rbac-proxy/0.log" Sep 17 18:18:23.605582 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.605557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/ovn-controller/0.log" Sep 17 18:18:23.625398 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.625370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/ovn-acl-logging/0.log" Sep 17 18:18:23.649280 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.649258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/kube-rbac-proxy-node/0.log" Sep 17 18:18:23.673852 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.673827 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 18:18:23.697699 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.697681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/northd/0.log" Sep 17 18:18:23.721988 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.721951 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/nbdb/0.log" Sep 17 18:18:23.744750 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.744716 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/sbdb/0.log" Sep 17 18:18:23.778921 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:23.778890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nn7p_0f136a54-692c-4341-9ab7-842badca08d8/ovnkube-controller/0.log" Sep 17 18:18:25.093339 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:25.093308 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4w6hg_1d2031ff-d0de-4aa5-88fe-41533edd24dd/network-check-target-container/0.log" Sep 17 18:18:25.967394 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:25.967367 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-brfk6_3ac0164e-4f31-409d-8aba-677ee5757d43/iptables-alerter/0.log" Sep 17 18:18:26.593790 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:26.593760 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-62n2b_12d2b3ce-8fe2-4f45-b467-988972662ec0/tuned/0.log" Sep 17 18:18:29.939453 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:29.939421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss4z7_ac37dc63-b27c-4e5a-bc63-e2f9504ce7de/csi-driver/0.log" Sep 17 18:18:29.959689 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:29.959663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss4z7_ac37dc63-b27c-4e5a-bc63-e2f9504ce7de/csi-node-driver-registrar/0.log" Sep 17 18:18:29.979299 ip-10-0-137-166 kubenswrapper[2579]: I0917 18:18:29.979275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ss4z7_ac37dc63-b27c-4e5a-bc63-e2f9504ce7de/csi-liveness-probe/0.log"