Jun 08 15:40:51.041202 ip-10-0-128-38 systemd[1]: Starting Kubernetes Kubelet... Jun 08 15:40:51.477153 ip-10-0-128-38 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:40:51.477153 ip-10-0-128-38 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 15:40:51.477153 ip-10-0-128-38 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:40:51.477153 ip-10-0-128-38 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 15:40:51.477153 ip-10-0-128-38 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 15:40:51.479403 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.479295 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486544 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486573 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486578 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486582 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486585 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486589 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486592 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.486581 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486594 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486598 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486601 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486604 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486607 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486610 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486612 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486615 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486617 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486620 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486623 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486626 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486628 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486631 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486633 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486636 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486638 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486641 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486643 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486646 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.486925 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486649 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486652 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486654 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486657 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486660 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486672 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486675 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486677 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486680 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486683 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486687 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486692 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486695 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486698 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486702 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486705 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486707 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486710 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486713 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.487411 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486716 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486720 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486725 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486728 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486732 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486734 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486737 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486740 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486742 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486745 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486748 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486751 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486753 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486755 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486758 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486761 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486764 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486766 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486769 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.487894 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486772 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486775 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486777 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486780 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486782 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486785 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486788 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486790 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486793 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486796 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486799 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486801 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486804 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486807 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486810 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486813 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486816 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486820 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486824 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.488364 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486826 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486829 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486832 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486853 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486856 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486859 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486862 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486866 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486869 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486872 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486875 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486877 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486880 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486884 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.486887 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487628 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487635 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487638 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487641 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487643 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.488853 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487646 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487649 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487652 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487655 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487658 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487661 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487663 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487666 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487668 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487671 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487673 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487676 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487680 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487682 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487685 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487688 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487690 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487693 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487695 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.489347 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487698 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487701 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487703 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487706 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487709 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487711 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487716 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487719 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487722 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487725 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487727 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487730 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487733 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487736 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487738 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487741 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487744 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487746 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487748 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487751 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.490754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487754 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487756 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487758 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487761 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487764 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487766 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487770 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487773 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487776 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487779 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487781 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487784 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487787 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487789 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487792 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487794 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487797 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487799 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487802 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487805 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.491288 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487808 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487811 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487813 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487816 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487819 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487822 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487824 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487826 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487831 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487854 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487858 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487861 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487864 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487867 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487870 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487873 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487876 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487879 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487882 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.491802 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487894 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487899 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487903 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487907 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487911 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487915 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487917 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487920 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487923 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487925 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487928 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487931 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487935 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487937 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487940 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.487943 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488353 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488359 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488361 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488364 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.492298 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488367 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488371 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488374 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488377 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488379 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488382 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488385 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488388 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488391 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488393 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488398 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488402 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488406 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488410 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488413 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488416 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488418 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488421 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488424 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.492822 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488427 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488429 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488432 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488435 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488439 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488443 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488447 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488450 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488454 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488458 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488462 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488465 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488468 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488470 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488473 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488476 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488479 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488481 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488484 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488486 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.493312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488489 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488491 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488495 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488497 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488500 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488503 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488507 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488511 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488514 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488516 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488519 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488522 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488524 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488527 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488529 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488532 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488535 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488538 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488541 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488543 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.493857 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488546 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488549 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488551 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488554 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488556 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488559 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488561 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488564 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488566 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488569 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488571 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488574 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488576 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488579 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488582 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488586 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488589 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488591 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488594 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488596 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.494376 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488599 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488602 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488604 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488606 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488609 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488612 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488616 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488619 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488622 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488625 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488628 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488631 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488634 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488637 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488639 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.488642 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488734 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488744 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488751 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488756 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 15:40:51.494922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488760 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488763 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488768 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488772 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488778 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488783 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488789 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488794 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488799 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488803 2577 flags.go:64] FLAG: --cgroup-root="" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488807 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488812 2577 flags.go:64] FLAG: --client-ca-file="" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488817 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488821 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488825 2577 flags.go:64] FLAG: --cluster-domain="" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488829 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488850 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488854 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488858 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488863 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488866 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488869 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488873 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488876 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 08 15:40:51.495460 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488879 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488882 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488885 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488888 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488893 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488896 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488899 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488902 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488905 2577 flags.go:64] FLAG: --enable-server="true" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488908 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488913 2577 flags.go:64] FLAG: --event-burst="100" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488916 2577 flags.go:64] FLAG: --event-qps="50" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488919 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488922 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488925 2577 flags.go:64] FLAG: --eviction-hard="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488934 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488937 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488940 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488943 2577 flags.go:64] FLAG: --eviction-soft="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488946 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488949 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488953 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488956 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488959 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488963 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 15:40:51.496064 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488966 2577 flags.go:64] FLAG: --feature-gates="" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488976 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488978 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488982 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488985 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488988 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488991 2577 flags.go:64] FLAG: --help="false" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488994 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.488997 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489000 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489003 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489006 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489010 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489013 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489016 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489019 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489022 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489025 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489028 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489030 2577 flags.go:64] FLAG: --kube-reserved="" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489033 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489036 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489040 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489043 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 15:40:51.496722 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489046 2577 flags.go:64] FLAG: --lock-file="" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489049 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489052 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489055 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489061 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489064 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489067 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489071 2577 flags.go:64] FLAG: --logging-format="text" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489074 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489077 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489080 2577 flags.go:64] FLAG: --manifest-url="" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489083 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489088 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489091 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489095 2577 flags.go:64] FLAG: --max-pods="110" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489098 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489101 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489104 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489107 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489110 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489113 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489116 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489124 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489127 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489130 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 15:40:51.497338 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489133 2577 flags.go:64] FLAG: --pod-cidr="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489136 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489142 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489145 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489148 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489153 2577 flags.go:64] FLAG: --port="10250" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489156 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489159 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07cdd939da2363ef8" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489162 2577 flags.go:64] FLAG: --qos-reserved="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489165 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489169 2577 flags.go:64] FLAG: --register-node="true" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489172 2577 flags.go:64] FLAG: --register-with-taints="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489176 2577 flags.go:64] FLAG: --registry-burst="10" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489179 2577 flags.go:64] FLAG: --registry-qps="5" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489182 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489185 2577 flags.go:64] FLAG: --reserved-memory="" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489189 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489192 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489195 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489198 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489201 2577 flags.go:64] FLAG: --runonce="false" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489204 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489207 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489210 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489213 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 15:40:51.498001 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489216 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489219 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489222 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489225 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489228 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489231 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489234 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489237 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489240 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489242 2577 flags.go:64] FLAG: --system-cgroups="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489245 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489251 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489255 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489258 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489262 2577 flags.go:64] FLAG: --tls-min-version="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489265 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489268 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489271 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489274 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489277 2577 flags.go:64] FLAG: --v="2" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489281 2577 flags.go:64] FLAG: --version="false" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489289 2577 flags.go:64] FLAG: --vmodule="" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489293 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.489297 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 15:40:51.498608 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489430 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489436 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489440 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489443 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489446 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489449 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489452 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489455 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489457 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489460 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489463 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489465 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489468 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489470 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489473 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489475 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489478 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489481 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489484 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.499215 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489486 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489491 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489494 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489498 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489501 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489503 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489506 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489508 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489511 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489514 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489517 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489519 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489522 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489524 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489527 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489529 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489532 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489535 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489537 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489540 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.499687 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489543 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489545 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489548 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489551 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489554 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489558 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489561 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489564 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489567 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489570 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489573 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489575 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489578 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489582 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489585 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489589 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489591 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489594 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489597 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489600 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.500245 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489602 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489605 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489607 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489610 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489613 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489616 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489619 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489621 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489624 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489626 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489629 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489632 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489634 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489637 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489640 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489643 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489646 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489648 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489651 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489654 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.500784 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489656 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489659 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489662 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489664 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489667 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489671 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489673 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489677 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489681 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489685 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489688 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489691 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489693 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489696 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489698 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489702 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489704 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489707 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489710 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.501317 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.489713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.490909 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.498663 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.498688 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.499965 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.499979 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500042 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500048 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500051 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500055 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500058 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500061 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500064 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500067 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500069 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.501803 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500072 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500075 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500078 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500080 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500083 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500086 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500088 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500091 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500093 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500096 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500098 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500101 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500104 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500107 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500110 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500112 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500115 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500118 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500122 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500125 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.502230 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500129 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500132 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500135 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500137 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500140 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500142 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500145 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500150 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500154 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500157 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500160 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500163 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500167 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500170 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500173 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500175 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500179 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500181 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500184 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500187 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.502747 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500190 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500192 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500197 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500201 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500204 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500208 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500211 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500214 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500216 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500219 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500222 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500225 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500228 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500232 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500235 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500237 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500240 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500243 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500246 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.503314 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500248 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500251 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500254 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500257 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500260 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500263 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500266 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500268 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500271 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500274 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500277 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500279 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500282 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500285 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500287 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500290 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500292 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500295 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500298 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500300 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.503797 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500303 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500306 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500309 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500311 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500314 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500317 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500320 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500324 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500327 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500331 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500334 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.500340 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500463 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500468 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 15:40:51.504312 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500471 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500476 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500479 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500482 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500485 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500488 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500491 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500494 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500496 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500499 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500502 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500505 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500507 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500510 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500512 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500515 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500518 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500521 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500524 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 08 15:40:51.504672 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500527 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500529 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500532 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500535 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500539 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500541 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500544 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500548 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500550 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500553 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500555 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500558 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500560 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500563 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500565 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500568 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500571 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500575 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500578 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 15:40:51.505143 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500581 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500583 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500586 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500589 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500591 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500594 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500596 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500598 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500601 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500604 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500607 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500610 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500612 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500615 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500618 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500621 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500624 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500626 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500629 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500632 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 15:40:51.505624 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500635 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500639 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500642 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500644 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500647 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500649 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500652 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500655 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500657 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500660 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500662 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500665 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500668 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500670 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500673 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500675 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500678 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500681 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500684 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500686 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500689 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 15:40:51.506189 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500692 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500696 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500699 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500701 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500704 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500707 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500709 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500712 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500714 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500717 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500720 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500723 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500725 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500729 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500732 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500735 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500739 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 15:40:51.506715 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:51.500742 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.500748 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.500929 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.505072 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.506668 2577 server.go:1019] "Starting client certificate rotation" Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.506780 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 15:40:51.507204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.506817 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 15:40:51.511111 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.511085 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 15:40:51.518441 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.518408 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 15:40:51.535438 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.535405 2577 log.go:25] "Validated CRI v1 runtime API" Jun 08 15:40:51.539077 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.539052 2577 log.go:25] "Validated CRI v1 image API" Jun 08 15:40:51.539331 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.539312 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 15:40:51.540070 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.540054 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 15:40:51.544647 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.544619 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c01da27-d6f6-4be8-9238-44e84726b1a9:/dev/nvme0n1p3 7d55e935-fdd4-4eaa-b67f-6a468e4ce3aa:/dev/nvme0n1p4] Jun 08 15:40:51.544726 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.544646 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 15:40:51.549130 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.549010 2577 manager.go:216] Machine: {Timestamp:2026-06-08 15:40:51.548495151 +0000 UTC m=+0.379434520 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3047992 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262e7f2b1ea9a5978de578b3dddb20 SystemUUID:ec262e7f-2b1e-a9a5-978d-e578b3dddb20 BootID:1853646c-ba53-459b-bb78-b86b1fc2fe2e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:f0:c8:6d:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:f0:c8:6d:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:10:fb:2f:08:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 15:40:51.549130 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.549120 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 15:40:51.549265 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.549207 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 15:40:51.552547 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.552509 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 15:40:51.552702 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.552550 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 15:40:51.553535 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.553517 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 15:40:51.553535 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.553536 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 15:40:51.553603 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.553544 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 15:40:51.554255 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.554241 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 15:40:51.555213 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.555199 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 15:40:51.559219 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559202 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 08 15:40:51.559352 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559342 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 15:40:51.559385 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559375 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 08 15:40:51.559416 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559385 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 15:40:51.559416 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559400 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 15:40:51.559416 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559410 2577 kubelet.go:398] "Adding apiserver pod source" Jun 08 15:40:51.559496 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559421 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 15:40:51.559828 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559814 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 15:40:51.559912 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.559866 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 15:40:51.562175 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.562153 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 15:40:51.562342 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.562325 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kllgf" Jun 08 15:40:51.563975 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.563958 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 15:40:51.564058 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.563989 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 15:40:51.565233 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565219 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565238 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565244 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565250 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565259 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565265 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 15:40:51.565274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565273 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 15:40:51.565439 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565279 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 15:40:51.565439 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565287 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 15:40:51.565439 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565292 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 15:40:51.565439 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565300 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 15:40:51.565439 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.565306 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 15:40:51.566263 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.566248 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 15:40:51.566263 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.566259 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 15:40:51.568496 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.568468 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 15:40:51.568580 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.568488 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 15:40:51.568736 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.568632 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 15:40:51.570174 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.570151 2577 server.go:1268] "Started kubelet" Jun 08 15:40:51.570860 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.570806 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 15:40:51.570951 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.570739 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 15:40:51.571020 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.570964 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 15:40:51.571345 ip-10-0-128-38 systemd[1]: Started Kubernetes Kubelet. Jun 08 15:40:51.572288 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.572272 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kllgf" Jun 08 15:40:51.572512 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.572499 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 08 15:40:51.572786 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.572768 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 15:40:51.577377 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.577353 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 15:40:51.579528 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.578301 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-38.ec2.internal.18b7255b4484ab81 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-38.ec2.internal,UID:ip-10-0-128-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-38.ec2.internal,},FirstTimestamp:2026-06-08 15:40:51.570117505 +0000 UTC m=+0.401056878,LastTimestamp:2026-06-08 15:40:51.570117505 +0000 UTC m=+0.401056878,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-38.ec2.internal,}" Jun 08 15:40:51.580797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.580775 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 15:40:51.580797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.580786 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 15:40:51.580974 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.580901 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.581475 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.581455 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 15:40:51.581621 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.581458 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 15:40:51.581621 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.581492 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 15:40:51.581621 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.581610 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 08 15:40:51.581621 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.581620 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 08 15:40:51.582295 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582275 2577 factory.go:55] Registering systemd factory Jun 08 15:40:51.582295 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582295 2577 factory.go:223] Registration of the systemd container factory successfully Jun 08 15:40:51.582503 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582491 2577 factory.go:153] Registering CRI-O factory Jun 08 15:40:51.582503 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582503 2577 factory.go:223] Registration of the crio container factory successfully Jun 08 15:40:51.582601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582560 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 15:40:51.582601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582590 2577 factory.go:103] Registering Raw factory Jun 08 15:40:51.582601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.582600 2577 manager.go:1196] Started watching for new ooms in manager Jun 08 15:40:51.583089 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.583071 2577 manager.go:349] Starting recovery of all containers Jun 08 15:40:51.592118 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.592086 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:51.594632 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.594133 2577 manager.go:354] Recovery completed Jun 08 15:40:51.595558 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.595538 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-38.ec2.internal\" not found" node="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.595614 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.595559 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 08 15:40:51.598399 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.598385 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.601413 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.601394 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.601514 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.601427 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.601514 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.601438 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.602066 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602053 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 15:40:51.602066 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602062 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.602066 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602067 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 15:40:51.602187 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602088 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 08 15:40:51.602961 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602947 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.603024 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602978 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.603024 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.602988 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.603573 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.603557 2577 policy_none.go:49] "None policy: Start" Jun 08 15:40:51.603573 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.603575 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 15:40:51.603682 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.603585 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 15:40:51.605241 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.605228 2577 policy_none.go:47] "Start" Jun 08 15:40:51.644563 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.644542 2577 manager.go:337] "Starting Device Plugin manager" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.644619 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.644639 2577 server.go:87] "Starting device plugin registration server" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.644946 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.644956 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.645069 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.645155 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.645163 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.645865 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.645906 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.659671 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.658654 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 15:40:51.660104 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.659898 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 15:40:51.660104 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.659945 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 15:40:51.660104 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.659972 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 15:40:51.660104 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.660072 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 15:40:51.662540 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.662514 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:51.746100 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.746012 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.747165 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.747130 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.747274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.747172 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.747274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.747184 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.747274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.747206 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.755688 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.755665 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.755788 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.755696 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-38.ec2.internal\": node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.760781 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.760756 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal"] Jun 08 15:40:51.760901 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.760829 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.762676 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.762655 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.762826 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.762689 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.762826 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.762705 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.764206 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.764186 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.764318 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.764299 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.764374 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.764335 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.765726 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.765696 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.765892 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765880 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.765962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765913 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.765962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765929 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.765962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765882 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.766103 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765978 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.766103 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.765991 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.767187 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.767170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.767262 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.767197 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 15:40:51.768040 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.768022 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientMemory" Jun 08 15:40:51.768137 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.768053 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 15:40:51.768137 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.768069 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeHasSufficientPID" Jun 08 15:40:51.797773 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.797748 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-38.ec2.internal\" not found" node="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.802643 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.802624 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-38.ec2.internal\" not found" node="ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.866209 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.866176 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.882927 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.882896 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.882927 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.882930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.883128 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.882946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed7c9a934fd45d5df80522620ae23db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-38.ec2.internal\" (UID: \"0ed7c9a934fd45d5df80522620ae23db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.966808 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:51.966764 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:51.983102 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983075 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.983183 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.983183 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed7c9a934fd45d5df80522620ae23db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-38.ec2.internal\" (UID: \"0ed7c9a934fd45d5df80522620ae23db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.983183 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ed7c9a934fd45d5df80522620ae23db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-38.ec2.internal\" (UID: \"0ed7c9a934fd45d5df80522620ae23db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.983300 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983183 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:51.983300 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:51.983208 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c4726127a30a94eb9d8dc4454bc6613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal\" (UID: \"1c4726127a30a94eb9d8dc4454bc6613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:52.067600 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.067524 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.102023 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.101996 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:52.107039 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.106888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:52.167919 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.167879 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.268441 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.268410 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.368994 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.368959 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.469707 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.469677 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.506216 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.506186 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 15:40:52.506873 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.506334 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 15:40:52.506873 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.506372 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 15:40:52.570379 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.570349 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.579312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.579269 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 15:35:51 +0000 UTC" deadline="2028-01-11 00:05:03.784105717 +0000 UTC" Jun 08 15:40:52.579312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.579301 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13952h24m11.204807098s" Jun 08 15:40:52.651978 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:52.651945 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed7c9a934fd45d5df80522620ae23db.slice/crio-bdbc987391ba46b0275fb1f75a6a184bddfd997ac4175732c9ec496eb8ab43c0 WatchSource:0}: Error finding container bdbc987391ba46b0275fb1f75a6a184bddfd997ac4175732c9ec496eb8ab43c0: Status 404 returned error can't find the container with id bdbc987391ba46b0275fb1f75a6a184bddfd997ac4175732c9ec496eb8ab43c0 Jun 08 15:40:52.652325 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:52.652304 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4726127a30a94eb9d8dc4454bc6613.slice/crio-fc0d6071c5ed9967d52d311f33d0ba5fb8b90a0fcad4ff34aaebef1864e86fc1 WatchSource:0}: Error finding container fc0d6071c5ed9967d52d311f33d0ba5fb8b90a0fcad4ff34aaebef1864e86fc1: Status 404 returned error can't find the container with id fc0d6071c5ed9967d52d311f33d0ba5fb8b90a0fcad4ff34aaebef1864e86fc1 Jun 08 15:40:52.659535 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.659517 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 15:40:52.663402 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.663348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" event={"ID":"1c4726127a30a94eb9d8dc4454bc6613","Type":"ContainerStarted","Data":"fc0d6071c5ed9967d52d311f33d0ba5fb8b90a0fcad4ff34aaebef1864e86fc1"} Jun 08 15:40:52.664341 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.664317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" event={"ID":"0ed7c9a934fd45d5df80522620ae23db","Type":"ContainerStarted","Data":"bdbc987391ba46b0275fb1f75a6a184bddfd997ac4175732c9ec496eb8ab43c0"} Jun 08 15:40:52.671510 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.671486 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.772019 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:52.771985 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-38.ec2.internal\" not found" Jun 08 15:40:52.792170 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.792137 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:52.842555 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.842529 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:52.881605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.881577 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" Jun 08 15:40:52.892184 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.892121 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 15:40:52.893112 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.893097 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" Jun 08 15:40:52.903610 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:52.903394 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 15:40:53.361402 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.361296 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:53.561607 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.561557 2577 apiserver.go:52] "Watching apiserver" Jun 08 15:40:53.567813 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.567779 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 15:40:53.568224 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.568202 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-qcmxg","openshift-network-operator/iptables-alerter-pcrg9","kube-system/konnectivity-agent-q55cx","kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qvl46","openshift-image-registry/node-ca-gsmxf","openshift-network-diagnostics/network-check-target-snvmk","openshift-ovn-kubernetes/ovnkube-node-cjzn7","kube-system/global-pull-secret-syncer-6b2tx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft","openshift-dns/node-resolver-sspcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-hz6t9","openshift-multus/multus-kzvz9"] Jun 08 15:40:53.569769 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.569743 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.570957 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.570935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.572502 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.572476 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 15:40:53.572502 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.572491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hjvgs\"" Jun 08 15:40:53.572633 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.572487 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.572633 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.572488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.573308 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 15:40:53.573308 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573079 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.573308 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.573308 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573291 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 15:40:53.573308 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573303 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 15:40:53.573599 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.573599 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.573514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-59tgv\"" Jun 08 15:40:53.574365 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.574344 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.575721 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.575491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 15:40:53.575721 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.575517 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w98pd\"" Jun 08 15:40:53.575721 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.575528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 15:40:53.575721 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.575585 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.576317 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.576296 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c924q\"" Jun 08 15:40:53.576400 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.576317 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 15:40:53.576910 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.576867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.577775 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.577751 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mgvbv\"" Jun 08 15:40:53.577775 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.577766 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.578659 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.578141 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.578659 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.578372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.578659 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.578456 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:40:53.579906 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.579640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l7mw8\"" Jun 08 15:40:53.580195 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.580134 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 15:40:53.582284 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.580313 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.582284 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.580388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:53.582284 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.580447 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.582284 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.580515 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:40:53.582284 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.581362 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 15:40:53.582785 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.582716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.584718 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.584699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.584821 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.584788 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:40:53.585682 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.585662 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.585968 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.585947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 15:40:53.586085 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.586038 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rrpx6\"" Jun 08 15:40:53.586140 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.585947 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.586309 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.586294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.587886 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.587594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.588808 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.588788 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.588907 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.588807 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.588976 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.588927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kw2wj\"" Jun 08 15:40:53.590613 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.590592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 15:40:53.590725 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.590707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 15:40:53.590975 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.590954 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 15:40:53.591051 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591004 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gmcnf\"" Jun 08 15:40:53.591093 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591080 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591217 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz4bn\" (UniqueName: \"kubernetes.io/projected/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-kube-api-access-hz4bn\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591294 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/418707b8-a008-48a7-ba13-85b8e144fd90-agent-certs\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-netns\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-daemon-config\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-systemd\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-os-release\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.591564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-modprobe-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-kubelet\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591611 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73724b61-4edb-461b-a907-5f56d8bc480f-iptables-alerter-script\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-sys-fs\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-multus\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrb8m\" (UniqueName: \"kubernetes.io/projected/b33bd503-0fb2-495e-94af-f6f1f56a6463-kube-api-access-mrb8m\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-host\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfab48c-0d30-4b7d-bfa6-da966c41a559-host\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/418707b8-a008-48a7-ba13-85b8e144fd90-konnectivity-ca\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-kubernetes\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-conf\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-sys\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-hostroot\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.591992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-multus-certs\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-device-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-conf-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592114 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwbn\" (UniqueName: \"kubernetes.io/projected/d77557cf-e80d-483f-ac21-5a8a7c87f638-kube-api-access-sjwbn\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-dbus\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592174 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysconfig\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-var-lib-kubelet\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-tmp\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592319 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqtz\" (UniqueName: \"kubernetes.io/projected/ecfab48c-0d30-4b7d-bfa6-da966c41a559-kube-api-access-2bqtz\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-bin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-cnibin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-os-release\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-lib-modules\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-registration-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-tuned\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgl95\" (UniqueName: \"kubernetes.io/projected/73724b61-4edb-461b-a907-5f56d8bc480f-kube-api-access-xgl95\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-system-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.592806 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-socket-dir-parent\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-etc-kubernetes\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592680 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecfab48c-0d30-4b7d-bfa6-da966c41a559-serviceca\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73724b61-4edb-461b-a907-5f56d8bc480f-host-slash\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chd66\" (UniqueName: \"kubernetes.io/projected/de6148fa-d691-4721-bb46-6122c133c73d-kube-api-access-chd66\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-cni-binary-copy\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-system-cni-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cnibin\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592804 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-kubelet-config\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-k8s-cni-cncf-io\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-socket-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.593569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.592959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-run\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.594204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.594041 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 15:40:53.611103 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.611074 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-85lsl" Jun 08 15:40:53.619183 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.619154 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-85lsl" Jun 08 15:40:53.682322 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.682283 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 15:40:53.693266 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-var-lib-kubelet\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-tmp\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-log-socket\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-config\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqtz\" (UniqueName: \"kubernetes.io/projected/ecfab48c-0d30-4b7d-bfa6-da966c41a559-kube-api-access-2bqtz\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-node-log\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-bin\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.693464 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.693734 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-bin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.693734 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-cnibin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.693734 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-cnibin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.693734 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-var-lib-kubelet\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-os-release\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-bin\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.693996 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694078 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694101 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-lib-modules\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694099 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-os-release\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-env-overrides\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.694169 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-registration-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-tuned\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694232 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-lib-modules\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.694241 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:40:54.194217452 +0000 UTC m=+3.025156833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgl95\" (UniqueName: \"kubernetes.io/projected/73724b61-4edb-461b-a907-5f56d8bc480f-kube-api-access-xgl95\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.694506 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-netd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-registration-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-system-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-socket-dir-parent\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-etc-kubernetes\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694440 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-system-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecfab48c-0d30-4b7d-bfa6-da966c41a559-serviceca\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-socket-dir-parent\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73724b61-4edb-461b-a907-5f56d8bc480f-host-slash\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-etc-kubernetes\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmnc2\" (UniqueName: \"kubernetes.io/projected/cc87851b-dc81-46b1-b67b-0e1768fe11dc-kube-api-access-vmnc2\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-var-lib-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694536 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73724b61-4edb-461b-a907-5f56d8bc480f-host-slash\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chd66\" (UniqueName: \"kubernetes.io/projected/de6148fa-d691-4721-bb46-6122c133c73d-kube-api-access-chd66\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-ovn\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-script-lib\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.695339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-cni-binary-copy\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-system-cni-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cnibin\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-kubelet-config\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-system-cni-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694855 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cnibin\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694889 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-etc-selinux\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-kubelet-config\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-k8s-cni-cncf-io\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-socket-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-run\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.694961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ecfab48c-0d30-4b7d-bfa6-da966c41a559-serviceca\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46qm\" (UniqueName: \"kubernetes.io/projected/2fb649b9-be07-4e2d-a619-a4370187c94a-kube-api-access-n46qm\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-k8s-cni-cncf-io\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz4bn\" (UniqueName: \"kubernetes.io/projected/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-kube-api-access-hz4bn\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-run\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-socket-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/418707b8-a008-48a7-ba13-85b8e144fd90-agent-certs\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695165 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-cni-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-netns\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695260 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-daemon-config\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-systemd\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-cni-binary-copy\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb649b9-be07-4e2d-a619-a4370187c94a-tmp-dir\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-systemd\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-systemd-units\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-netns\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695516 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovn-node-metrics-cert\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-os-release\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-os-release\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.696823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695681 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-daemon-config\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695783 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-modprobe-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-etc-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-kubelet\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73724b61-4edb-461b-a907-5f56d8bc480f-iptables-alerter-script\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-kubelet\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.695984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-systemd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-modprobe-d\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-sys-fs\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-netns\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79t2h\" (UniqueName: \"kubernetes.io/projected/5a364cc6-45bb-446e-8b6f-f8ed753758d7-kube-api-access-79t2h\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.697576 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-multus\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696182 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrb8m\" (UniqueName: \"kubernetes.io/projected/b33bd503-0fb2-495e-94af-f6f1f56a6463-kube-api-access-mrb8m\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-host\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfab48c-0d30-4b7d-bfa6-da966c41a559-host\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/418707b8-a008-48a7-ba13-85b8e144fd90-konnectivity-ca\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecfab48c-0d30-4b7d-bfa6-da966c41a559-host\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-kubernetes\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-conf\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696358 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-sys-fs\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-sys\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-hostroot\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-sys\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-host\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-hostroot\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696540 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-cni-binary-copy\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-multus-certs\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.698337 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-device-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-conf-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696727 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-kubernetes\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwbn\" (UniqueName: \"kubernetes.io/projected/d77557cf-e80d-483f-ac21-5a8a7c87f638-kube-api-access-sjwbn\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73724b61-4edb-461b-a907-5f56d8bc480f-iptables-alerter-script\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696827 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de6148fa-d691-4721-bb46-6122c133c73d-device-dir\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696832 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysctl-conf\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696824 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-kubelet\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696881 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb649b9-be07-4e2d-a619-a4370187c94a-hosts-file\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696892 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-run-multus-certs\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-slash\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-multus-conf-dir\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-dbus\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysconfig\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/418707b8-a008-48a7-ba13-85b8e144fd90-konnectivity-ca\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.696958 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b33bd503-0fb2-495e-94af-f6f1f56a6463-host-var-lib-cni-multus\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.699181 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.697072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-dbus\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:53.699987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.697105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-sysconfig\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.697792 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-etc-tuned\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.697811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d77557cf-e80d-483f-ac21-5a8a7c87f638-tmp\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.699987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.698434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/418707b8-a008-48a7-ba13-85b8e144fd90-agent-certs\") pod \"konnectivity-agent-q55cx\" (UID: \"418707b8-a008-48a7-ba13-85b8e144fd90\") " pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.704366 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.704326 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:40:53.704366 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.704354 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:40:53.704366 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.704367 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:53.704688 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.704437 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:40:54.204416241 +0000 UTC m=+3.035355602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:53.705696 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.705616 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqtz\" (UniqueName: \"kubernetes.io/projected/ecfab48c-0d30-4b7d-bfa6-da966c41a559-kube-api-access-2bqtz\") pod \"node-ca-gsmxf\" (UID: \"ecfab48c-0d30-4b7d-bfa6-da966c41a559\") " pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.706080 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.706055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgl95\" (UniqueName: \"kubernetes.io/projected/73724b61-4edb-461b-a907-5f56d8bc480f-kube-api-access-xgl95\") pod \"iptables-alerter-pcrg9\" (UID: \"73724b61-4edb-461b-a907-5f56d8bc480f\") " pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.706910 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.706882 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chd66\" (UniqueName: \"kubernetes.io/projected/de6148fa-d691-4721-bb46-6122c133c73d-kube-api-access-chd66\") pod \"aws-ebs-csi-driver-node-c9pft\" (UID: \"de6148fa-d691-4721-bb46-6122c133c73d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.707130 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.707079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwbn\" (UniqueName: \"kubernetes.io/projected/d77557cf-e80d-483f-ac21-5a8a7c87f638-kube-api-access-sjwbn\") pod \"tuned-qvl46\" (UID: \"d77557cf-e80d-483f-ac21-5a8a7c87f638\") " pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.707685 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.707662 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz4bn\" (UniqueName: \"kubernetes.io/projected/3d28b837-6d9e-43fb-aaa0-60aae2c7a440-kube-api-access-hz4bn\") pod \"multus-additional-cni-plugins-hz6t9\" (UID: \"3d28b837-6d9e-43fb-aaa0-60aae2c7a440\") " pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.708326 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.708273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrb8m\" (UniqueName: \"kubernetes.io/projected/b33bd503-0fb2-495e-94af-f6f1f56a6463-kube-api-access-mrb8m\") pod \"multus-kzvz9\" (UID: \"b33bd503-0fb2-495e-94af-f6f1f56a6463\") " pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.797572 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb649b9-be07-4e2d-a619-a4370187c94a-tmp-dir\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.797572 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-systemd-units\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797572 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797630 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-systemd-units\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovn-node-metrics-cert\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-etc-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-kubelet\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797775 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-kubelet\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-etc-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797824 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-systemd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797870 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-systemd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fb649b9-be07-4e2d-a619-a4370187c94a-tmp-dir\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-netns\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.797921 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-netns\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79t2h\" (UniqueName: \"kubernetes.io/projected/5a364cc6-45bb-446e-8b6f-f8ed753758d7-kube-api-access-79t2h\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb649b9-be07-4e2d-a619-a4370187c94a-hosts-file\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798007 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-slash\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.797973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-log-socket\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.798049 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798069 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-log-socket\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2fb649b9-be07-4e2d-a619-a4370187c94a-hosts-file\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-config\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-slash\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-node-log\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-node-log\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-bin\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:53.798183 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:40:54.298161807 +0000 UTC m=+3.129101169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798197 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-bin\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.798529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-env-overrides\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-netd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798296 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-run-ovn-kubernetes\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmnc2\" (UniqueName: \"kubernetes.io/projected/cc87851b-dc81-46b1-b67b-0e1768fe11dc-kube-api-access-vmnc2\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-host-cni-netd\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-var-lib-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-var-lib-openvswitch\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-ovn\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-script-lib\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n46qm\" (UniqueName: \"kubernetes.io/projected/2fb649b9-be07-4e2d-a619-a4370187c94a-kube-api-access-n46qm\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798617 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a364cc6-45bb-446e-8b6f-f8ed753758d7-run-ovn\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798619 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-config\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.798640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-env-overrides\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.799243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.799071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovnkube-script-lib\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.800074 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.800055 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a364cc6-45bb-446e-8b6f-f8ed753758d7-ovn-node-metrics-cert\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.810383 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.810353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46qm\" (UniqueName: \"kubernetes.io/projected/2fb649b9-be07-4e2d-a619-a4370187c94a-kube-api-access-n46qm\") pod \"node-resolver-sspcd\" (UID: \"2fb649b9-be07-4e2d-a619-a4370187c94a\") " pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.810545 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.810437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79t2h\" (UniqueName: \"kubernetes.io/projected/5a364cc6-45bb-446e-8b6f-f8ed753758d7-kube-api-access-79t2h\") pod \"ovnkube-node-cjzn7\" (UID: \"5a364cc6-45bb-446e-8b6f-f8ed753758d7\") " pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:53.810614 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.810593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmnc2\" (UniqueName: \"kubernetes.io/projected/cc87851b-dc81-46b1-b67b-0e1768fe11dc-kube-api-access-vmnc2\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:53.883562 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.883459 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" Jun 08 15:40:53.891284 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.891258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzvz9" Jun 08 15:40:53.901104 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.901076 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" Jun 08 15:40:53.905794 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.905772 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:40:53.906049 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.906028 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 15:40:53.914035 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.914004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvl46" Jun 08 15:40:53.919984 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.919967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gsmxf" Jun 08 15:40:53.927478 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.927449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pcrg9" Jun 08 15:40:53.935126 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.935099 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sspcd" Jun 08 15:40:53.939929 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:53.939910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:40:54.201301 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.201212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:54.201467 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.201337 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:54.201467 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.201411 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:40:55.201392188 +0000 UTC m=+4.032331554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:54.302208 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.302178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:54.302355 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.302226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:54.302423 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302358 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:54.302465 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302438 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:40:55.302416826 +0000 UTC m=+4.133356187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:54.302465 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302365 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:40:54.302465 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302464 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:40:54.302599 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302476 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:54.302599 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.302530 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:40:55.302516831 +0000 UTC m=+4.133456189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:54.445227 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.445141 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb649b9_be07_4e2d_a619_a4370187c94a.slice/crio-3081fe33756fa2c26d2f15d0421cce495986a5aeca1f2d7d609d84065fce83be WatchSource:0}: Error finding container 3081fe33756fa2c26d2f15d0421cce495986a5aeca1f2d7d609d84065fce83be: Status 404 returned error can't find the container with id 3081fe33756fa2c26d2f15d0421cce495986a5aeca1f2d7d609d84065fce83be Jun 08 15:40:54.447395 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.447362 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77557cf_e80d_483f_ac21_5a8a7c87f638.slice/crio-28cd7826c029062170fa6dd131671f6182a519c358770037906449d283d1c2fc WatchSource:0}: Error finding container 28cd7826c029062170fa6dd131671f6182a519c358770037906449d283d1c2fc: Status 404 returned error can't find the container with id 28cd7826c029062170fa6dd131671f6182a519c358770037906449d283d1c2fc Jun 08 15:40:54.450358 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.450333 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73724b61_4edb_461b_a907_5f56d8bc480f.slice/crio-dccc93d3f65e41d04a9d97189e08a614f752167d15f920282ce62d147c888052 WatchSource:0}: Error finding container dccc93d3f65e41d04a9d97189e08a614f752167d15f920282ce62d147c888052: Status 404 returned error can't find the container with id dccc93d3f65e41d04a9d97189e08a614f752167d15f920282ce62d147c888052 Jun 08 15:40:54.452291 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.452269 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d28b837_6d9e_43fb_aaa0_60aae2c7a440.slice/crio-c242fdcab7d39b6cadd9ef2d2a0998a9989f50c194107eda5f5b42ec3505f4d2 WatchSource:0}: Error finding container c242fdcab7d39b6cadd9ef2d2a0998a9989f50c194107eda5f5b42ec3505f4d2: Status 404 returned error can't find the container with id c242fdcab7d39b6cadd9ef2d2a0998a9989f50c194107eda5f5b42ec3505f4d2 Jun 08 15:40:54.452704 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.452680 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6148fa_d691_4721_bb46_6122c133c73d.slice/crio-a673380863bb5ec8a9cea6a3302000407027eb498a29f045839d20405c9f1f3c WatchSource:0}: Error finding container a673380863bb5ec8a9cea6a3302000407027eb498a29f045839d20405c9f1f3c: Status 404 returned error can't find the container with id a673380863bb5ec8a9cea6a3302000407027eb498a29f045839d20405c9f1f3c Jun 08 15:40:54.454537 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.454447 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418707b8_a008_48a7_ba13_85b8e144fd90.slice/crio-fd37374d0edb0019abe2bdf000de540d22b064766d02a4066ea845675b21746b WatchSource:0}: Error finding container fd37374d0edb0019abe2bdf000de540d22b064766d02a4066ea845675b21746b: Status 404 returned error can't find the container with id fd37374d0edb0019abe2bdf000de540d22b064766d02a4066ea845675b21746b Jun 08 15:40:54.455637 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.455613 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33bd503_0fb2_495e_94af_f6f1f56a6463.slice/crio-881b475b705ee8bdbbcc118ab08f73ac806b54c4a7ea3df101bb375d07b9ac97 WatchSource:0}: Error finding container 881b475b705ee8bdbbcc118ab08f73ac806b54c4a7ea3df101bb375d07b9ac97: Status 404 returned error can't find the container with id 881b475b705ee8bdbbcc118ab08f73ac806b54c4a7ea3df101bb375d07b9ac97 Jun 08 15:40:54.456540 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:40:54.456517 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a364cc6_45bb_446e_8b6f_f8ed753758d7.slice/crio-459dec2d52f6143ec4eaad5a694006d24222ee82acf90de7edf96a478e942161 WatchSource:0}: Error finding container 459dec2d52f6143ec4eaad5a694006d24222ee82acf90de7edf96a478e942161: Status 404 returned error can't find the container with id 459dec2d52f6143ec4eaad5a694006d24222ee82acf90de7edf96a478e942161 Jun 08 15:40:54.621406 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.621343 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:35:53 +0000 UTC" deadline="2027-12-24 09:22:13.609241487 +0000 UTC" Jun 08 15:40:54.621406 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.621401 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13529h41m18.987844254s" Jun 08 15:40:54.660808 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.660780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:54.660955 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:54.660913 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:40:54.668122 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.668091 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"459dec2d52f6143ec4eaad5a694006d24222ee82acf90de7edf96a478e942161"} Jun 08 15:40:54.670120 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.670096 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzvz9" event={"ID":"b33bd503-0fb2-495e-94af-f6f1f56a6463","Type":"ContainerStarted","Data":"881b475b705ee8bdbbcc118ab08f73ac806b54c4a7ea3df101bb375d07b9ac97"} Jun 08 15:40:54.672341 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.672305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pcrg9" event={"ID":"73724b61-4edb-461b-a907-5f56d8bc480f","Type":"ContainerStarted","Data":"dccc93d3f65e41d04a9d97189e08a614f752167d15f920282ce62d147c888052"} Jun 08 15:40:54.674601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.674558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" event={"ID":"0ed7c9a934fd45d5df80522620ae23db","Type":"ContainerStarted","Data":"6967c1761403329adf182bbd2e6fbc72ca81f0fc925ac6e76a1e99bb60c7ed83"} Jun 08 15:40:54.675883 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.675860 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q55cx" event={"ID":"418707b8-a008-48a7-ba13-85b8e144fd90","Type":"ContainerStarted","Data":"fd37374d0edb0019abe2bdf000de540d22b064766d02a4066ea845675b21746b"} Jun 08 15:40:54.677042 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.677022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" event={"ID":"de6148fa-d691-4721-bb46-6122c133c73d","Type":"ContainerStarted","Data":"a673380863bb5ec8a9cea6a3302000407027eb498a29f045839d20405c9f1f3c"} Jun 08 15:40:54.678187 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.678165 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerStarted","Data":"c242fdcab7d39b6cadd9ef2d2a0998a9989f50c194107eda5f5b42ec3505f4d2"} Jun 08 15:40:54.679093 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.679077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvl46" event={"ID":"d77557cf-e80d-483f-ac21-5a8a7c87f638","Type":"ContainerStarted","Data":"28cd7826c029062170fa6dd131671f6182a519c358770037906449d283d1c2fc"} Jun 08 15:40:54.680077 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.680050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sspcd" event={"ID":"2fb649b9-be07-4e2d-a619-a4370187c94a","Type":"ContainerStarted","Data":"3081fe33756fa2c26d2f15d0421cce495986a5aeca1f2d7d609d84065fce83be"} Jun 08 15:40:54.681311 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.681291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gsmxf" event={"ID":"ecfab48c-0d30-4b7d-bfa6-da966c41a559","Type":"ContainerStarted","Data":"f84d13a460319dee0c5914f5013699848b284639710726fd9cc658aeb31a252b"} Jun 08 15:40:54.691227 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:54.691185 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-38.ec2.internal" podStartSLOduration=2.69117133 podStartE2EDuration="2.69117133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:40:54.691055064 +0000 UTC m=+3.521994442" watchObservedRunningTime="2026-06-08 15:40:54.69117133 +0000 UTC m=+3.522110709" Jun 08 15:40:55.213415 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.213148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:55.213622 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.213595 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:55.213774 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.213760 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:40:57.213734716 +0000 UTC m=+6.044674087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:55.313938 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.313902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:55.314121 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.313978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:55.314187 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.314134 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:40:55.314187 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.314151 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:40:55.314187 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.314164 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:55.314329 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.314238 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:40:57.314204827 +0000 UTC m=+6.145144191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:55.315159 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.315140 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:55.315244 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.315198 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:40:57.31518208 +0000 UTC m=+6.146121438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:55.621654 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.621584 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 15:35:53 +0000 UTC" deadline="2027-11-23 17:54:47.078393176 +0000 UTC" Jun 08 15:40:55.621654 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.621651 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12794h13m51.456746744s" Jun 08 15:40:55.663400 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.662680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:55.663400 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.662828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:40:55.663400 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.663244 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:55.663400 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:55.663338 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:40:55.699794 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.699755 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c4726127a30a94eb9d8dc4454bc6613" containerID="eb34afbbb1f16917c77b6a916c90e64810b30fe3dffaee387a42825fe5c041a4" exitCode=0 Jun 08 15:40:55.700798 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:55.700768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" event={"ID":"1c4726127a30a94eb9d8dc4454bc6613","Type":"ContainerDied","Data":"eb34afbbb1f16917c77b6a916c90e64810b30fe3dffaee387a42825fe5c041a4"} Jun 08 15:40:56.660620 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:56.660583 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:56.661149 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:56.660718 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:40:56.709018 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:56.708955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" event={"ID":"1c4726127a30a94eb9d8dc4454bc6613","Type":"ContainerStarted","Data":"0fb9ab0a8e534da4331cea2a1aa9b3d403d293ecf6cc4d6e483d44b983e2463e"} Jun 08 15:40:57.231315 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:57.231272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:57.231508 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.231429 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:57.231508 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.231496 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:41:01.231476825 +0000 UTC m=+10.062416207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:40:57.331659 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:57.331613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:57.331832 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:57.331702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:57.331935 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.331878 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:40:57.331935 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.331900 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:40:57.331935 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.331914 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:57.332080 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.331978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:41:01.331957257 +0000 UTC m=+10.162896620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:40:57.332080 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.332053 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:57.332192 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.332090 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:41:01.332078092 +0000 UTC m=+10.163017453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:40:57.660533 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:57.660492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:57.660715 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.660642 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:40:57.661143 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:57.660492 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:57.661143 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:57.661125 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:40:58.660235 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:58.660200 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:40:58.660406 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:58.660357 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:40:59.664649 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:59.664611 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:40:59.665074 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:59.664750 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:40:59.666325 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:40:59.665612 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:40:59.666325 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:40:59.666012 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:00.660258 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:00.660218 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:00.660431 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:00.660340 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:01.266040 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:01.265387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:01.266040 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.265577 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:01.266040 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.265663 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:41:09.265630268 +0000 UTC m=+18.096569629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:01.366384 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:01.366346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:01.366584 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:01.366426 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:01.366654 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.366591 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:41:01.366654 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.366611 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:41:01.366654 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.366625 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:01.366812 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.366686 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:41:09.366667407 +0000 UTC m=+18.197606768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:01.367157 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.367137 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:01.367248 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.367194 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:41:09.367176631 +0000 UTC m=+18.198115994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:01.661803 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:01.661648 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:01.661803 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.661771 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:01.662056 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:01.661858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:01.662056 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:01.661955 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:02.660983 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:02.660947 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:02.661452 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:02.661088 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:03.663854 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:03.663802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:03.664329 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:03.663983 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:03.664329 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:03.664009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:03.664329 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:03.664123 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:04.660299 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:04.660260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:04.660464 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:04.660381 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:05.664052 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:05.664024 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:05.664052 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:05.664049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:05.664510 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:05.664130 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:05.664510 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:05.664275 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:06.660850 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:06.660802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:06.661020 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:06.660945 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:07.663992 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:07.663960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:07.664424 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:07.664092 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:07.664424 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:07.664139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:07.664424 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:07.664272 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:08.660395 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:08.660357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:08.660640 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:08.660483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:09.324282 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:09.324237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:09.324848 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.324385 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:09.324848 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.324463 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:41:25.32444223 +0000 UTC m=+34.155381588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:09.425564 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:09.425527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:09.425762 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:09.425588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:09.425762 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425702 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:09.425762 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425737 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:41:09.425762 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425757 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:41:09.426014 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425771 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:09.426014 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425774 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:41:25.425758343 +0000 UTC m=+34.256697720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:09.426014 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.425822 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:41:25.425804446 +0000 UTC m=+34.256743832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:09.664609 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:09.664579 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:09.664785 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:09.664581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:09.664785 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.664712 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:09.664898 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:09.664781 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:10.660663 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:10.660626 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:10.661239 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:10.660777 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:11.664111 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:11.664060 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:11.664111 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:11.664062 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:11.664611 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:11.664196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:11.664611 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:11.664252 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:12.661010 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:12.660973 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:12.661195 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:12.661105 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:13.666033 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:13.665355 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:13.666033 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:13.665496 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:13.666033 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:13.665889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:13.666033 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:13.665979 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:13.758869 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:13.758419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvl46" event={"ID":"d77557cf-e80d-483f-ac21-5a8a7c87f638","Type":"ContainerStarted","Data":"c13c2466366d826841610e281d0bc8cf7f4b1da5f1554e36194c377da4d70ac2"} Jun 08 15:41:13.782594 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:13.782271 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-38.ec2.internal" podStartSLOduration=21.782249118 podStartE2EDuration="21.782249118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:40:56.725239117 +0000 UTC m=+5.556178497" watchObservedRunningTime="2026-06-08 15:41:13.782249118 +0000 UTC m=+22.613188498" Jun 08 15:41:14.661197 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.661010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:14.661327 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:14.661307 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:14.762569 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.762528 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzvz9" event={"ID":"b33bd503-0fb2-495e-94af-f6f1f56a6463","Type":"ContainerStarted","Data":"1512726f3cbeb5aa9bbf57f069a05b476722a8da2083c5f7337047b54e6d7b52"} Jun 08 15:41:14.764041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.764017 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q55cx" event={"ID":"418707b8-a008-48a7-ba13-85b8e144fd90","Type":"ContainerStarted","Data":"6a355dd851bd66c127ba5717e459fd43839674a10d9779c837fdaa683c8e2854"} Jun 08 15:41:14.765420 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.765396 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" event={"ID":"de6148fa-d691-4721-bb46-6122c133c73d","Type":"ContainerStarted","Data":"4e8a800769789348744e0aecde56efe81bf58173f5fc190802900c82b7d5e878"} Jun 08 15:41:14.766771 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.766741 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="c72954e1e38e934d488df59170d1bd33064f228e7b19b5102acbb98e051fa6fc" exitCode=0 Jun 08 15:41:14.766873 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.766815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"c72954e1e38e934d488df59170d1bd33064f228e7b19b5102acbb98e051fa6fc"} Jun 08 15:41:14.768177 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.768151 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sspcd" event={"ID":"2fb649b9-be07-4e2d-a619-a4370187c94a","Type":"ContainerStarted","Data":"55a9eb4cbb8123efe811a8e8d1ad26c7c43daccbb0a42bf17e0845088ba06adc"} Jun 08 15:41:14.769394 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.769372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gsmxf" event={"ID":"ecfab48c-0d30-4b7d-bfa6-da966c41a559","Type":"ContainerStarted","Data":"2c5bd2500367ad8addfcff55e04624b71bce19229dfdcaf41a5c0a6f1fcfcaf1"} Jun 08 15:41:14.771769 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.771734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"2d57e9886ce2534aba8b9822b8e4fca4403be6904a363bcf7aa55e4fef1aa211"} Jun 08 15:41:14.771866 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.771822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"d32cf7cf0e715b1f7e2a9ab42523004501702deaacf51cf57e2d43d745f59161"} Jun 08 15:41:14.771914 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.771895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"0b52ab5cd154115b2b70b397458a2aa599405ec6be4b3c9abf0b045579e61f05"} Jun 08 15:41:14.771948 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.771930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"074b1e45b176c9ec3ea3b07805beba514f5e16b5d24b39b7dee0773c492498ce"} Jun 08 15:41:14.771986 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.771969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"f61cf1408f147bdcae357ddc910afa36c4296c012c8acfdc251ca23f5ba745c7"} Jun 08 15:41:14.772021 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.772001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"6cee2ccf28167f254d39f39d72af5f603492dc9210f50dcdeb5b4f194dab1a6a"} Jun 08 15:41:14.787877 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.787802 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kzvz9" podStartSLOduration=4.5874092730000005 podStartE2EDuration="23.787784314s" totalImagesPullingTime="19.200375041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:14.787665671 +0000 UTC m=+23.618605051" watchObservedRunningTime="2026-06-08 15:41:14.787784314 +0000 UTC m=+23.618723693" Jun 08 15:41:14.788069 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.788050 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qvl46" podStartSLOduration=4.626718771 podStartE2EDuration="23.788042244s" totalImagesPullingTime="19.161323473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:13.782743822 +0000 UTC m=+22.613683200" watchObservedRunningTime="2026-06-08 15:41:14.788042244 +0000 UTC m=+23.618981623" Jun 08 15:41:14.834065 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.834010 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q55cx" podStartSLOduration=4.683042127 podStartE2EDuration="23.833993243s" totalImagesPullingTime="19.150951116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:14.81295308 +0000 UTC m=+23.643892458" watchObservedRunningTime="2026-06-08 15:41:14.833993243 +0000 UTC m=+23.664932622" Jun 08 15:41:14.873154 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.873094 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sspcd" podStartSLOduration=4.701333572 podStartE2EDuration="23.873072667s" totalImagesPullingTime="19.171739095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:14.83443654 +0000 UTC m=+23.665375920" watchObservedRunningTime="2026-06-08 15:41:14.873072667 +0000 UTC m=+23.704012048" Jun 08 15:41:14.894555 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.894446 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gsmxf" podStartSLOduration=4.740942348 podStartE2EDuration="23.894422621s" totalImagesPullingTime="19.153480273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:14.894209665 +0000 UTC m=+23.725149044" watchObservedRunningTime="2026-06-08 15:41:14.894422621 +0000 UTC m=+23.725362001" Jun 08 15:41:14.985112 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:14.985085 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 15:41:15.659513 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.659392 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T15:41:14.985103079Z","UUID":"7586d6d4-5330-4ae8-bb09-543725a9136b","Handler":null,"Name":"","Endpoint":""} Jun 08 15:41:15.660539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.660273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:15.660539 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:15.660418 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:15.660539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.660480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:15.660807 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:15.660582 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:15.661524 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.661504 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 15:41:15.661657 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.661549 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 15:41:15.776361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.776260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pcrg9" event={"ID":"73724b61-4edb-461b-a907-5f56d8bc480f","Type":"ContainerStarted","Data":"d1f2dc354b4ba4bc669ba373b33f1fd2ae93edbbaf90fe477f09a459b9a81105"} Jun 08 15:41:15.778897 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.778862 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" event={"ID":"de6148fa-d691-4721-bb46-6122c133c73d","Type":"ContainerStarted","Data":"1e50e0ad69d32fa09915912a46c151dc282c04b9e9ffd8ff3b642c298d4df93c"} Jun 08 15:41:15.794472 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:15.794414 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pcrg9" podStartSLOduration=5.639151764 podStartE2EDuration="24.794394828s" totalImagesPullingTime="19.155243064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:15.793954665 +0000 UTC m=+24.624894046" watchObservedRunningTime="2026-06-08 15:41:15.794394828 +0000 UTC m=+24.625334206" Jun 08 15:41:16.213641 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.213553 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:41:16.214242 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.214214 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:41:16.661059 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.661023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:16.661220 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:16.661149 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:16.784858 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.784758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"b31af0fe8f59cb94de6c4a7fe48326d8a5155eb0f9c6fd3a4175ea17be8375d3"} Jun 08 15:41:16.787086 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.787046 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" event={"ID":"de6148fa-d691-4721-bb46-6122c133c73d","Type":"ContainerStarted","Data":"a29749ced9d558fd34f82d29acf60ce463bd761d940411d61ee0406c6e20f009"} Jun 08 15:41:16.787684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.787342 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:41:16.788152 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.788132 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q55cx" Jun 08 15:41:16.806871 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:16.806806 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c9pft" podStartSLOduration=4.622163141 podStartE2EDuration="25.806792091s" totalImagesPullingTime="21.18462895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:16.806632351 +0000 UTC m=+25.637571730" watchObservedRunningTime="2026-06-08 15:41:16.806792091 +0000 UTC m=+25.637731470" Jun 08 15:41:17.660789 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:17.660753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:17.661008 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:17.660756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:17.661008 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:17.660919 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:17.661008 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:17.660965 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:18.660755 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:18.660723 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:18.661300 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:18.660867 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:19.661084 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.660900 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:19.661529 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.660905 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:19.661529 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:19.661172 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:19.661529 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:19.661249 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:19.795766 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.795731 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="bf276b18ed2c9797be19baf611d83c3e22c8156bc2ce4de5d3f3f0b8ab811b84" exitCode=0 Jun 08 15:41:19.795955 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.795817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"bf276b18ed2c9797be19baf611d83c3e22c8156bc2ce4de5d3f3f0b8ab811b84"} Jun 08 15:41:19.799650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.799626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" event={"ID":"5a364cc6-45bb-446e-8b6f-f8ed753758d7","Type":"ContainerStarted","Data":"a055459cfd582208623dbf91bf2ad5c9ff9d9e1dd7792e367b1d1671638bc981"} Jun 08 15:41:19.799874 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.799863 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:19.815762 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.815734 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:19.848341 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:19.848289 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" podStartSLOduration=9.612785484 podStartE2EDuration="28.848273134s" totalImagesPullingTime="19.23548765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:19.847130938 +0000 UTC m=+28.678070318" watchObservedRunningTime="2026-06-08 15:41:19.848273134 +0000 UTC m=+28.679212513" Jun 08 15:41:20.660548 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:20.660375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:20.660756 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:20.660620 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:20.803346 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:20.803309 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:20.803647 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:20.803406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:20.822113 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:20.822081 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:21.083891 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.083860 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b2tx"] Jun 08 15:41:21.084070 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.083998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:21.084109 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:21.084082 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:21.087945 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.087920 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcmxg"] Jun 08 15:41:21.088050 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.088025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:21.088124 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:21.088108 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:21.091704 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.091677 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snvmk"] Jun 08 15:41:21.091808 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.091786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:21.091919 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:21.091898 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:21.805832 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.805795 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="d4998160728f877b367d4c289265a83472af513285b0ee9e96b1a96dde70286b" exitCode=0 Jun 08 15:41:21.806440 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:21.805885 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"d4998160728f877b367d4c289265a83472af513285b0ee9e96b1a96dde70286b"} Jun 08 15:41:22.660408 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:22.660374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:22.660581 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:22.660377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:22.660581 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:22.660479 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:22.660654 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:22.660595 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:22.660654 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:22.660377 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:22.660720 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:22.660707 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:23.812151 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:23.812117 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="f5976a783daa9b88e6f70fb75ff8fab25ea48aa58a26aaec8a4b97d39142bd48" exitCode=0 Jun 08 15:41:23.812738 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:23.812163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"f5976a783daa9b88e6f70fb75ff8fab25ea48aa58a26aaec8a4b97d39142bd48"} Jun 08 15:41:24.660366 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:24.660329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:24.660559 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:24.660329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:24.660559 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:24.660452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-snvmk" podUID="12da5d21-dfaf-484b-b9d1-ce50cbc33b03" Jun 08 15:41:24.660559 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:24.660546 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b2tx" podUID="40552af1-61fc-4ba5-9eb5-4ae02f7f3cab" Jun 08 15:41:24.660726 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:24.660330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:24.660726 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:24.660639 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:41:25.354012 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:25.353973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:25.354498 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.354137 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:25.354498 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.354210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret podName:40552af1-61fc-4ba5-9eb5-4ae02f7f3cab nodeName:}" failed. No retries permitted until 2026-06-08 15:41:57.354189519 +0000 UTC m=+66.185128876 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret") pod "global-pull-secret-syncer-6b2tx" (UID: "40552af1-61fc-4ba5-9eb5-4ae02f7f3cab") : object "kube-system"/"original-pull-secret" not registered Jun 08 15:41:25.454519 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:25.454484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:25.454697 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:25.454542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:25.454697 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454649 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:25.454697 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454664 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 15:41:25.454697 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454678 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 15:41:25.454697 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454690 2577 projected.go:196] Error preparing data for projected volume kube-api-access-wx247 for pod openshift-network-diagnostics/network-check-target-snvmk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:25.454961 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454716 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:41:57.454698904 +0000 UTC m=+66.285638276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 15:41:25.454961 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:25.454734 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247 podName:12da5d21-dfaf-484b-b9d1-ce50cbc33b03 nodeName:}" failed. No retries permitted until 2026-06-08 15:41:57.454725621 +0000 UTC m=+66.285664983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wx247" (UniqueName: "kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247") pod "network-check-target-snvmk" (UID: "12da5d21-dfaf-484b-b9d1-ce50cbc33b03") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 15:41:26.459857 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.459571 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-38.ec2.internal" event="NodeReady" Jun 08 15:41:26.460304 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.459934 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 15:41:26.505006 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.504974 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vclk7"] Jun 08 15:41:26.507761 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.507740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.507979 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.507957 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4lqhm"] Jun 08 15:41:26.509920 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.509899 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db5c2\"" Jun 08 15:41:26.510041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.509965 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 15:41:26.510041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.510034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.510205 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.510183 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 15:41:26.512120 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.512102 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 15:41:26.512322 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.512300 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lhljw\"" Jun 08 15:41:26.512434 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.512377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 15:41:26.512434 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.512388 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 15:41:26.520017 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.519942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vclk7"] Jun 08 15:41:26.522451 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.522423 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lqhm"] Jun 08 15:41:26.661171 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.661138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:26.661355 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.661138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:26.661355 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.661138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:26.662612 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252d42b7-6b92-4516-a2db-d0141a60d2d6-cert\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.662719 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11fd30a2-4d8d-47f3-9453-173f94d297ce-config-volume\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.662719 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11fd30a2-4d8d-47f3-9453-173f94d297ce-tmp-dir\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.662820 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgz94\" (UniqueName: \"kubernetes.io/projected/11fd30a2-4d8d-47f3-9453-173f94d297ce-kube-api-access-dgz94\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.662889 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.662889 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.662874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtck\" (UniqueName: \"kubernetes.io/projected/252d42b7-6b92-4516-a2db-d0141a60d2d6-kube-api-access-2jtck\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.663991 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.663969 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w2dh4\"" Jun 08 15:41:26.664110 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.664001 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 15:41:26.664110 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.663976 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 15:41:26.664225 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.664194 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 15:41:26.664345 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.664314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 15:41:26.664435 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.664367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vhp96\"" Jun 08 15:41:26.764087 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.763958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252d42b7-6b92-4516-a2db-d0141a60d2d6-cert\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.764087 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11fd30a2-4d8d-47f3-9453-173f94d297ce-config-volume\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.764087 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11fd30a2-4d8d-47f3-9453-173f94d297ce-tmp-dir\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764090 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgz94\" (UniqueName: \"kubernetes.io/projected/11fd30a2-4d8d-47f3-9453-173f94d297ce-kube-api-access-dgz94\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtck\" (UniqueName: \"kubernetes.io/projected/252d42b7-6b92-4516-a2db-d0141a60d2d6-kube-api-access-2jtck\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:26.764263 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:26.764334 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:27.264311964 +0000 UTC m=+36.095251338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:26.764504 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11fd30a2-4d8d-47f3-9453-173f94d297ce-tmp-dir\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.764948 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.764925 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11fd30a2-4d8d-47f3-9453-173f94d297ce-config-volume\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.769352 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.769323 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/252d42b7-6b92-4516-a2db-d0141a60d2d6-cert\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.774015 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.773987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgz94\" (UniqueName: \"kubernetes.io/projected/11fd30a2-4d8d-47f3-9453-173f94d297ce-kube-api-access-dgz94\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:26.774015 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.774006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtck\" (UniqueName: \"kubernetes.io/projected/252d42b7-6b92-4516-a2db-d0141a60d2d6-kube-api-access-2jtck\") pod \"ingress-canary-4lqhm\" (UID: \"252d42b7-6b92-4516-a2db-d0141a60d2d6\") " pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:26.828541 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:26.828502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4lqhm" Jun 08 15:41:27.268631 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:27.268585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:27.268818 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:27.268762 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:27.268903 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:27.268847 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:28.268813517 +0000 UTC m=+37.099752893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:27.928073 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:27.928042 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4lqhm"] Jun 08 15:41:27.931909 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:41:27.931880 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252d42b7_6b92_4516_a2db_d0141a60d2d6.slice/crio-24582465fa0ebee7645eab109f582ca4b3dae67733d0ed6435f132df60d0d3e4 WatchSource:0}: Error finding container 24582465fa0ebee7645eab109f582ca4b3dae67733d0ed6435f132df60d0d3e4: Status 404 returned error can't find the container with id 24582465fa0ebee7645eab109f582ca4b3dae67733d0ed6435f132df60d0d3e4 Jun 08 15:41:28.277474 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:28.277433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:28.277647 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:28.277558 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:28.277647 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:28.277616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:30.277600898 +0000 UTC m=+39.108540257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:28.825995 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:28.825947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lqhm" event={"ID":"252d42b7-6b92-4516-a2db-d0141a60d2d6","Type":"ContainerStarted","Data":"24582465fa0ebee7645eab109f582ca4b3dae67733d0ed6435f132df60d0d3e4"} Jun 08 15:41:28.829393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:28.829156 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="552540ea65aa3cc5208a0d52ce6b67d148e6dede292d01a852382ecf303bb964" exitCode=0 Jun 08 15:41:28.829393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:28.829241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"552540ea65aa3cc5208a0d52ce6b67d148e6dede292d01a852382ecf303bb964"} Jun 08 15:41:29.835370 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:29.835327 2577 generic.go:356] "Generic (PLEG): container finished" podID="3d28b837-6d9e-43fb-aaa0-60aae2c7a440" containerID="5b126c2610b265105e63cd6361dd461fb25eb31a9a99837eb45eb3cf9190fa26" exitCode=0 Jun 08 15:41:29.835960 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:29.835379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerDied","Data":"5b126c2610b265105e63cd6361dd461fb25eb31a9a99837eb45eb3cf9190fa26"} Jun 08 15:41:29.837063 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:29.837041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4lqhm" event={"ID":"252d42b7-6b92-4516-a2db-d0141a60d2d6","Type":"ContainerStarted","Data":"ce9872fb319e73f1e3ac88f1a9a219d248f912fee97f562c00805e3df1b78237"} Jun 08 15:41:29.880539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:29.880476 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4lqhm" podStartSLOduration=2.16757813 podStartE2EDuration="3.880454347s" totalImagesPullingTime="1.712876217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:29.88031245 +0000 UTC m=+38.711251830" watchObservedRunningTime="2026-06-08 15:41:29.880454347 +0000 UTC m=+38.711393720" Jun 08 15:41:30.292327 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:30.292240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:30.292472 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:30.292402 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:30.292512 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:30.292481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:34.29246421 +0000 UTC m=+43.123403571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:30.842672 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:30.842641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" event={"ID":"3d28b837-6d9e-43fb-aaa0-60aae2c7a440","Type":"ContainerStarted","Data":"c444d5874284a2f2e45a1ec5f46507cd278379b5360fe7cd53c0523aeed25d12"} Jun 08 15:41:30.867220 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:30.867159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hz6t9" podStartSLOduration=10.435483136 podStartE2EDuration="39.867139104s" totalImagesPullingTime="29.431655968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:30.866120155 +0000 UTC m=+39.697059528" watchObservedRunningTime="2026-06-08 15:41:30.867139104 +0000 UTC m=+39.698078476" Jun 08 15:41:34.323804 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:34.323757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:34.324293 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:34.323923 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:34.324293 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:34.323990 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:42.323974544 +0000 UTC m=+51.154913902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:41.518377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.518344 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm"] Jun 08 15:41:41.549778 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.549697 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm"] Jun 08 15:41:41.549778 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.549782 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.550011 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.549808 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw"] Jun 08 15:41:41.552471 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.552440 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 15:41:41.553477 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.553450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 15:41:41.553701 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.553500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 15:41:41.553809 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.553590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 15:41:41.565132 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.565101 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw"] Jun 08 15:41:41.565273 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.565187 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.568180 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.568149 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 15:41:41.568326 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.568177 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 15:41:41.568508 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.568486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 15:41:41.568611 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.568594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 15:41:41.576134 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.576242 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7fzt\" (UniqueName: \"kubernetes.io/projected/97186960-c69f-470b-a6dd-a55c2476e032-kube-api-access-l7fzt\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.576242 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.576242 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576229 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-kube-api-access-7q42p\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.576344 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97186960-c69f-470b-a6dd-a55c2476e032-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.576344 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-tmp\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.576344 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576337 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.576435 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.576435 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.576403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.676965 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.676926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.676965 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.676970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7fzt\" (UniqueName: \"kubernetes.io/projected/97186960-c69f-470b-a6dd-a55c2476e032-kube-api-access-l7fzt\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677213 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.676998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677213 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-kube-api-access-7q42p\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.677213 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97186960-c69f-470b-a6dd-a55c2476e032-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677213 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-tmp\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.677440 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677226 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677440 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.677440 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677984 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677959 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/97186960-c69f-470b-a6dd-a55c2476e032-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.677984 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.677978 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-tmp\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.681101 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.681077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-ca\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.681210 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.681156 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.681266 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.681243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.681299 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.681271 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/97186960-c69f-470b-a6dd-a55c2476e032-hub\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.681355 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.681339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-klusterlet-config\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.685827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.685804 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/36d363ff-b98b-4fe4-9383-b84f2c97e2a2-kube-api-access-7q42p\") pod \"klusterlet-addon-workmgr-74bfc76987-9stqm\" (UID: \"36d363ff-b98b-4fe4-9383-b84f2c97e2a2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.685964 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.685919 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7fzt\" (UniqueName: \"kubernetes.io/projected/97186960-c69f-470b-a6dd-a55c2476e032-kube-api-access-l7fzt\") pod \"cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw\" (UID: \"97186960-c69f-470b-a6dd-a55c2476e032\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:41.860751 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.860720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:41.892782 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:41.892751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:41:42.036872 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:42.036848 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm"] Jun 08 15:41:42.039955 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:41:42.039910 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d363ff_b98b_4fe4_9383_b84f2c97e2a2.slice/crio-5c3b5a869fef16c4bd29e514ab6997016bcf5272ff36b7e338d6ac50ea02b5d0 WatchSource:0}: Error finding container 5c3b5a869fef16c4bd29e514ab6997016bcf5272ff36b7e338d6ac50ea02b5d0: Status 404 returned error can't find the container with id 5c3b5a869fef16c4bd29e514ab6997016bcf5272ff36b7e338d6ac50ea02b5d0 Jun 08 15:41:42.066348 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:42.066315 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw"] Jun 08 15:41:42.070179 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:41:42.070148 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97186960_c69f_470b_a6dd_a55c2476e032.slice/crio-c75921e9883431f87f0ae5db0367585d8eae39ab0b8aab2d14d668850cdab0a0 WatchSource:0}: Error finding container c75921e9883431f87f0ae5db0367585d8eae39ab0b8aab2d14d668850cdab0a0: Status 404 returned error can't find the container with id c75921e9883431f87f0ae5db0367585d8eae39ab0b8aab2d14d668850cdab0a0 Jun 08 15:41:42.385909 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:42.385863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:42.386117 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:42.385998 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:42.386117 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:42.386077 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:41:58.386058245 +0000 UTC m=+67.216997602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:41:42.870024 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:42.869981 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerStarted","Data":"5c3b5a869fef16c4bd29e514ab6997016bcf5272ff36b7e338d6ac50ea02b5d0"} Jun 08 15:41:42.870970 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:42.870950 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerStarted","Data":"c75921e9883431f87f0ae5db0367585d8eae39ab0b8aab2d14d668850cdab0a0"} Jun 08 15:41:47.891989 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:47.891952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerStarted","Data":"061586ab1069117a5a777cb4e2153b845ee1610af64c5b50965a5d510e7fd507"} Jun 08 15:41:47.891989 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:47.891994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerStarted","Data":"f61d0737a936fcea508d532e8aae82a2a6ff3e97a7da94e3548f637ba90ae188"} Jun 08 15:41:47.892451 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:47.892006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerStarted","Data":"ba6b563b673278d359b25a4477078059dfc5b0a6d6652ac5a67696e343023576"} Jun 08 15:41:47.911209 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:47.911145 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" podStartSLOduration=1.869370855 podStartE2EDuration="6.911124779s" totalImagesPullingTime="5.041753924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:47.909937321 +0000 UTC m=+56.740876701" watchObservedRunningTime="2026-06-08 15:41:47.911124779 +0000 UTC m=+56.742064160" Jun 08 15:41:48.896164 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:48.896069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerStarted","Data":"5c04dead3c6c38de13d5e747b0ce20d941e221591fe461b9ffb29705d7384af7"} Jun 08 15:41:48.896531 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:48.896357 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:48.897881 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:48.897862 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:41:48.914097 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:48.914046 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" podStartSLOduration=1.33104363 podStartE2EDuration="7.914029604s" totalImagesPullingTime="6.582985974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:41:48.913007207 +0000 UTC m=+57.743946599" watchObservedRunningTime="2026-06-08 15:41:48.914029604 +0000 UTC m=+57.744968982" Jun 08 15:41:52.828936 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:52.828907 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cjzn7" Jun 08 15:41:57.408691 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.408636 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:57.411474 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.411452 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 15:41:57.421271 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.421243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40552af1-61fc-4ba5-9eb5-4ae02f7f3cab-original-pull-secret\") pod \"global-pull-secret-syncer-6b2tx\" (UID: \"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab\") " pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:57.509356 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.509321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:41:57.509547 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.509371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:57.511831 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.511806 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 15:41:57.511952 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.511805 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 15:41:57.519912 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:57.519887 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 15:41:57.519992 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:57.519974 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:43:01.519954891 +0000 UTC m=+130.350894248 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : secret "metrics-daemon-secret" not found Jun 08 15:41:57.522224 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.522204 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 15:41:57.532501 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.532467 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx247\" (UniqueName: \"kubernetes.io/projected/12da5d21-dfaf-484b-b9d1-ce50cbc33b03-kube-api-access-wx247\") pod \"network-check-target-snvmk\" (UID: \"12da5d21-dfaf-484b-b9d1-ce50cbc33b03\") " pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:57.572611 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.572576 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b2tx" Jun 08 15:41:57.581230 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.581204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vhp96\"" Jun 08 15:41:57.589474 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.589434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:41:57.708047 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.708022 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b2tx"] Jun 08 15:41:57.710401 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:41:57.710373 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40552af1_61fc_4ba5_9eb5_4ae02f7f3cab.slice/crio-d1105ea45aee7f87d7192a8cddd11708218461b40aa32cbfc1a76d9605fdd738 WatchSource:0}: Error finding container d1105ea45aee7f87d7192a8cddd11708218461b40aa32cbfc1a76d9605fdd738: Status 404 returned error can't find the container with id d1105ea45aee7f87d7192a8cddd11708218461b40aa32cbfc1a76d9605fdd738 Jun 08 15:41:57.723126 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.723098 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-snvmk"] Jun 08 15:41:57.725726 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:41:57.725693 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12da5d21_dfaf_484b_b9d1_ce50cbc33b03.slice/crio-6630b8706209b93d7f392b61e51c12caa56027231b57ef460ae26cb681c36021 WatchSource:0}: Error finding container 6630b8706209b93d7f392b61e51c12caa56027231b57ef460ae26cb681c36021: Status 404 returned error can't find the container with id 6630b8706209b93d7f392b61e51c12caa56027231b57ef460ae26cb681c36021 Jun 08 15:41:57.920154 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.920121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snvmk" event={"ID":"12da5d21-dfaf-484b-b9d1-ce50cbc33b03","Type":"ContainerStarted","Data":"6630b8706209b93d7f392b61e51c12caa56027231b57ef460ae26cb681c36021"} Jun 08 15:41:57.921157 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:57.921135 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b2tx" event={"ID":"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab","Type":"ContainerStarted","Data":"d1105ea45aee7f87d7192a8cddd11708218461b40aa32cbfc1a76d9605fdd738"} Jun 08 15:41:58.414743 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:41:58.414701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:41:58.415226 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:58.414878 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:41:58.415226 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:41:58.414952 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:42:30.414932898 +0000 UTC m=+99.245872260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:42:02.938250 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:02.938215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-snvmk" event={"ID":"12da5d21-dfaf-484b-b9d1-ce50cbc33b03","Type":"ContainerStarted","Data":"2ac0986ef2784a0e20495ad3e5616bb2ab6f26f8a4dda8ff62c8fcf4b0d4384d"} Jun 08 15:42:02.938710 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:02.938347 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:42:02.939693 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:02.939668 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b2tx" event={"ID":"40552af1-61fc-4ba5-9eb5-4ae02f7f3cab","Type":"ContainerStarted","Data":"1277564d2a33cc9b2c646dd2cee79552be293e51c199b3eaa89e86166789ab4b"} Jun 08 15:42:02.954398 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:02.954346 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-snvmk" podStartSLOduration=67.472577612 podStartE2EDuration="1m11.954329842s" totalImagesPullingTime="4.48175223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:42:02.954009868 +0000 UTC m=+71.784949257" watchObservedRunningTime="2026-06-08 15:42:02.954329842 +0000 UTC m=+71.785269220" Jun 08 15:42:02.968276 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:02.968221 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6b2tx" podStartSLOduration=67.467329648 podStartE2EDuration="1m11.9682025s" totalImagesPullingTime="4.500872852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:42:02.967579572 +0000 UTC m=+71.798518954" watchObservedRunningTime="2026-06-08 15:42:02.9682025 +0000 UTC m=+71.799141879" Jun 08 15:42:30.442339 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:30.442197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:42:30.442339 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:42:30.442326 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:42:30.442873 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:42:30.442390 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:43:34.442375136 +0000 UTC m=+163.273314493 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:42:33.945792 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:42:33.945764 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-snvmk" Jun 08 15:43:01.561240 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:01.561181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:43:01.561760 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:01.561340 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 15:43:01.561760 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:01.561408 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs podName:cc87851b-dc81-46b1-b67b-0e1768fe11dc nodeName:}" failed. No retries permitted until 2026-06-08 15:45:03.561390684 +0000 UTC m=+252.392330041 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs") pod "network-metrics-daemon-qcmxg" (UID: "cc87851b-dc81-46b1-b67b-0e1768fe11dc") : secret "metrics-daemon-secret" not found Jun 08 15:43:29.521080 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:29.521025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vclk7" podUID="11fd30a2-4d8d-47f3-9453-173f94d297ce" Jun 08 15:43:29.683771 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:29.683717 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qcmxg" podUID="cc87851b-dc81-46b1-b67b-0e1768fe11dc" Jun 08 15:43:30.182781 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:30.182752 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vclk7" Jun 08 15:43:34.489166 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:34.489119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:43:34.489582 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:34.489256 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 15:43:34.489582 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:43:34.489310 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls podName:11fd30a2-4d8d-47f3-9453-173f94d297ce nodeName:}" failed. No retries permitted until 2026-06-08 15:45:36.489296249 +0000 UTC m=+285.320235610 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls") pod "dns-default-vclk7" (UID: "11fd30a2-4d8d-47f3-9453-173f94d297ce") : secret "dns-default-metrics-tls" not found Jun 08 15:43:40.660433 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:40.660346 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:43:48.897330 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:48.897276 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" podUID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 08 15:43:49.234847 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:49.234813 2577 generic.go:356] "Generic (PLEG): container finished" podID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" containerID="5c04dead3c6c38de13d5e747b0ce20d941e221591fe461b9ffb29705d7384af7" exitCode=1 Jun 08 15:43:49.235037 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:49.234891 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerDied","Data":"5c04dead3c6c38de13d5e747b0ce20d941e221591fe461b9ffb29705d7384af7"} Jun 08 15:43:49.235307 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:49.235285 2577 scope.go:117] "RemoveContainer" containerID="5c04dead3c6c38de13d5e747b0ce20d941e221591fe461b9ffb29705d7384af7" Jun 08 15:43:50.239850 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:50.239802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerStarted","Data":"bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602"} Jun 08 15:43:50.240219 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:50.240105 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:43:50.240631 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:43:50.240613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:44:49.740266 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:44:49.740237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sspcd_2fb649b9-be07-4e2d-a619-a4370187c94a/dns-node-resolver/0.log" Jun 08 15:44:50.940293 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:44:50.940265 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gsmxf_ecfab48c-0d30-4b7d-bfa6-da966c41a559/node-ca/0.log" Jun 08 15:44:51.344546 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:44:51.344524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lqhm_252d42b7-6b92-4516-a2db-d0141a60d2d6/serve-healthcheck-canary/0.log" Jun 08 15:45:03.623035 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:03.622979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:45:03.625259 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:03.625238 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc87851b-dc81-46b1-b67b-0e1768fe11dc-metrics-certs\") pod \"network-metrics-daemon-qcmxg\" (UID: \"cc87851b-dc81-46b1-b67b-0e1768fe11dc\") " pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:45:03.764278 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:03.764249 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w2dh4\"" Jun 08 15:45:03.772418 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:03.772394 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qcmxg" Jun 08 15:45:03.894717 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:03.894612 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qcmxg"] Jun 08 15:45:03.898589 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:03.898564 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc87851b_dc81_46b1_b67b_0e1768fe11dc.slice/crio-25f0a4d23a4cf169977074520ccd205724afeea6f4e8e92c7836107239f9ae11 WatchSource:0}: Error finding container 25f0a4d23a4cf169977074520ccd205724afeea6f4e8e92c7836107239f9ae11: Status 404 returned error can't find the container with id 25f0a4d23a4cf169977074520ccd205724afeea6f4e8e92c7836107239f9ae11 Jun 08 15:45:04.442552 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:04.442511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcmxg" event={"ID":"cc87851b-dc81-46b1-b67b-0e1768fe11dc","Type":"ContainerStarted","Data":"25f0a4d23a4cf169977074520ccd205724afeea6f4e8e92c7836107239f9ae11"} Jun 08 15:45:05.447145 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:05.447108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcmxg" event={"ID":"cc87851b-dc81-46b1-b67b-0e1768fe11dc","Type":"ContainerStarted","Data":"192ad67004d10eda58a4e00dba4186604333521075bf1642c4d5b46c1bf25903"} Jun 08 15:45:05.447610 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:05.447168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qcmxg" event={"ID":"cc87851b-dc81-46b1-b67b-0e1768fe11dc","Type":"ContainerStarted","Data":"b2b7b2832cf1a211806583f11888efc8820a9267fc4239d54564cd5222b33c83"} Jun 08 15:45:05.468610 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:05.468561 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qcmxg" podStartSLOduration=253.541209713 podStartE2EDuration="4m14.468545348s" totalImagesPullingTime="927.335635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:05.467172235 +0000 UTC m=+254.298111612" watchObservedRunningTime="2026-06-08 15:45:05.468545348 +0000 UTC m=+254.299484725" Jun 08 15:45:08.372743 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.372707 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9sclq"] Jun 08 15:45:08.374748 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.374730 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.377644 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.377620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 15:45:08.378648 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.378625 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 15:45:08.378757 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.378628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dvws4\"" Jun 08 15:45:08.378757 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.378689 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 15:45:08.378957 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.378943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 15:45:08.390897 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.390868 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9sclq"] Jun 08 15:45:08.460032 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.459998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.460206 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.460052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k648j\" (UniqueName: \"kubernetes.io/projected/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-api-access-k648j\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.460206 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.460092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-crio-socket\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.460206 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.460161 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.460206 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.460181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-data-volume\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561400 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561400 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-data-volume\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561629 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561629 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k648j\" (UniqueName: \"kubernetes.io/projected/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-api-access-k648j\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561629 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-crio-socket\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561629 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-crio-socket\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.561937 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.561917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-data-volume\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.562117 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.562097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.563850 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.563818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.570868 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.570828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k648j\" (UniqueName: \"kubernetes.io/projected/6c8776e2-15ed-4bbf-a87f-b00cc86c8050-kube-api-access-k648j\") pod \"insights-runtime-extractor-9sclq\" (UID: \"6c8776e2-15ed-4bbf-a87f-b00cc86c8050\") " pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.683015 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.682921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9sclq" Jun 08 15:45:08.805478 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:08.805443 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9sclq"] Jun 08 15:45:08.808021 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:08.807990 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8776e2_15ed_4bbf_a87f_b00cc86c8050.slice/crio-eb67b284774cb35e8ede2950947dc6afca533502d43ee824466be16b956b484a WatchSource:0}: Error finding container eb67b284774cb35e8ede2950947dc6afca533502d43ee824466be16b956b484a: Status 404 returned error can't find the container with id eb67b284774cb35e8ede2950947dc6afca533502d43ee824466be16b956b484a Jun 08 15:45:09.463530 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:09.463490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9sclq" event={"ID":"6c8776e2-15ed-4bbf-a87f-b00cc86c8050","Type":"ContainerStarted","Data":"9ba0e661cb2118d1570301b80425b0e18130e24fb4ab950c3f695b7fa35e28c9"} Jun 08 15:45:09.463967 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:09.463561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9sclq" event={"ID":"6c8776e2-15ed-4bbf-a87f-b00cc86c8050","Type":"ContainerStarted","Data":"eb67b284774cb35e8ede2950947dc6afca533502d43ee824466be16b956b484a"} Jun 08 15:45:10.468672 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:10.468638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9sclq" event={"ID":"6c8776e2-15ed-4bbf-a87f-b00cc86c8050","Type":"ContainerStarted","Data":"0205043f6578ce96e0f23dbe3a8c25a5c66084e8f37284137b9a850eb8b8d0b2"} Jun 08 15:45:11.473076 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:11.472989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9sclq" event={"ID":"6c8776e2-15ed-4bbf-a87f-b00cc86c8050","Type":"ContainerStarted","Data":"7e77e1777ed4b19084e82c6dd30ca66a29318c479fe1462fbe838ff30282c71b"} Jun 08 15:45:11.496941 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:11.496895 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9sclq" podStartSLOduration=1.262215265 podStartE2EDuration="3.496876697s" totalImagesPullingTime="2.234661432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:45:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:11.496817603 +0000 UTC m=+260.327757003" watchObservedRunningTime="2026-06-08 15:45:11.496876697 +0000 UTC m=+260.327816076" Jun 08 15:45:14.541947 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.541912 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d"] Jun 08 15:45:14.543910 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.543895 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.549015 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.548995 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 15:45:14.549967 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.549684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 15:45:14.549967 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.549731 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xmm5q\"" Jun 08 15:45:14.549967 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.549684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 15:45:14.550220 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.550082 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 15:45:14.550220 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.550113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 15:45:14.562718 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.562582 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d"] Jun 08 15:45:14.578710 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.578682 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vjxlc"] Jun 08 15:45:14.580816 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.580800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.589521 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:14.589496 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-128-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jun 08 15:45:14.589987 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:14.589966 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-128-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jun 08 15:45:14.590142 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.590131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cl9s6\"" Jun 08 15:45:14.590643 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.590625 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 15:45:14.602775 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.602903 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.602903 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btbtb\" (UniqueName: \"kubernetes.io/projected/791108c9-1a99-41a3-97bd-4c22461a4391-kube-api-access-btbtb\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.602903 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603007 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.603007 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791108c9-1a99-41a3-97bd-4c22461a4391-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.603007 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603007 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.602965 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-textfile\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603119 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.603013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfdr\" (UniqueName: \"kubernetes.io/projected/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-kube-api-access-twfdr\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603119 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.603032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-metrics-client-ca\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603119 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.603059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-root\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603119 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.603078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-wtmp\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.603119 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.603091 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-sys\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703573 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btbtb\" (UniqueName: \"kubernetes.io/projected/791108c9-1a99-41a3-97bd-4c22461a4391-kube-api-access-btbtb\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791108c9-1a99-41a3-97bd-4c22461a4391-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-textfile\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703728 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfdr\" (UniqueName: \"kubernetes.io/projected/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-kube-api-access-twfdr\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.703752 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-metrics-client-ca\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704060 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-root\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704060 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-wtmp\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704060 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-sys\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704060 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-sys\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704060 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.703944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-root\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704208 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.704062 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-wtmp\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704208 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.704087 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-textfile\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704468 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.704435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704468 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.704451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-metrics-client-ca\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.704616 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.704469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791108c9-1a99-41a3-97bd-4c22461a4391-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.706276 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.706245 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.706387 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.706368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791108c9-1a99-41a3-97bd-4c22461a4391-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.712479 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.712456 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfdr\" (UniqueName: \"kubernetes.io/projected/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-kube-api-access-twfdr\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:14.712791 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.712772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btbtb\" (UniqueName: \"kubernetes.io/projected/791108c9-1a99-41a3-97bd-4c22461a4391-kube-api-access-btbtb\") pod \"openshift-state-metrics-65f78d5c66-f587d\" (UID: \"791108c9-1a99-41a3-97bd-4c22461a4391\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.852804 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.852769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" Jun 08 15:45:14.979042 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:14.979010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d"] Jun 08 15:45:14.981754 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:14.981727 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791108c9_1a99_41a3_97bd_4c22461a4391.slice/crio-056c3a0d814d67721efe94818043d8fa23a2bd4701ea21ece89eaf8d414691e8 WatchSource:0}: Error finding container 056c3a0d814d67721efe94818043d8fa23a2bd4701ea21ece89eaf8d414691e8: Status 404 returned error can't find the container with id 056c3a0d814d67721efe94818043d8fa23a2bd4701ea21ece89eaf8d414691e8 Jun 08 15:45:15.485545 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:15.485511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" event={"ID":"791108c9-1a99-41a3-97bd-4c22461a4391","Type":"ContainerStarted","Data":"4ada32497fa7afbbba5280642ec3c9759bf686aedd516074a447d5c8a6a64ecb"} Jun 08 15:45:15.485720 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:15.485566 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" event={"ID":"791108c9-1a99-41a3-97bd-4c22461a4391","Type":"ContainerStarted","Data":"17fbafdbe6ae1e673243cbf6a26862f87fa43d97d362fca90e0d8ef85ebe8a38"} Jun 08 15:45:15.485720 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:15.485587 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" event={"ID":"791108c9-1a99-41a3-97bd-4c22461a4391","Type":"ContainerStarted","Data":"056c3a0d814d67721efe94818043d8fa23a2bd4701ea21ece89eaf8d414691e8"} Jun 08 15:45:15.703937 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:15.703903 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Jun 08 15:45:15.704302 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:15.703945 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Jun 08 15:45:15.704302 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:15.703985 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config podName:fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f nodeName:}" failed. No retries permitted until 2026-06-08 15:45:16.203967909 +0000 UTC m=+265.034907265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config") pod "node-exporter-vjxlc" (UID: "fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f") : failed to sync secret cache: timed out waiting for the condition Jun 08 15:45:15.704302 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:15.703999 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls podName:fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f nodeName:}" failed. No retries permitted until 2026-06-08 15:45:16.203992609 +0000 UTC m=+265.034931966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls") pod "node-exporter-vjxlc" (UID: "fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f") : failed to sync secret cache: timed out waiting for the condition Jun 08 15:45:15.826905 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:15.826810 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 15:45:15.863075 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:15.863046 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 15:45:16.217426 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.217386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:16.217622 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.217501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:16.219748 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.219719 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:16.219748 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.219742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f-node-exporter-tls\") pod \"node-exporter-vjxlc\" (UID: \"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f\") " pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:16.389233 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.389192 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjxlc" Jun 08 15:45:16.398652 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:16.398624 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc96a3ad_91e8_40dd_8a4a_8405fa8ea72f.slice/crio-14e14d5edaf7823422046c5386a781357d76163418056d24a08511ce77ab30a7 WatchSource:0}: Error finding container 14e14d5edaf7823422046c5386a781357d76163418056d24a08511ce77ab30a7: Status 404 returned error can't find the container with id 14e14d5edaf7823422046c5386a781357d76163418056d24a08511ce77ab30a7 Jun 08 15:45:16.491041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.490955 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" event={"ID":"791108c9-1a99-41a3-97bd-4c22461a4391","Type":"ContainerStarted","Data":"32b8376a2f57f6e10a4c43d932b1d03f76ee7ab18a7a49073faf4294ba69799a"} Jun 08 15:45:16.492079 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.492061 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjxlc" event={"ID":"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f","Type":"ContainerStarted","Data":"14e14d5edaf7823422046c5386a781357d76163418056d24a08511ce77ab30a7"} Jun 08 15:45:16.509404 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:16.509363 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-f587d" podStartSLOduration=1.376774261 podStartE2EDuration="2.509351819s" totalImagesPullingTime="1.132577558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:16.508276478 +0000 UTC m=+265.339215855" watchObservedRunningTime="2026-06-08 15:45:16.509351819 +0000 UTC m=+265.340291196" Jun 08 15:45:17.497041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:17.496947 2577 generic.go:356] "Generic (PLEG): container finished" podID="fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f" containerID="c2a8d9114c992437608c2909a133123f645742a0f1e6ab8eb42f7745aed8b2be" exitCode=0 Jun 08 15:45:17.497041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:17.497029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjxlc" event={"ID":"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f","Type":"ContainerDied","Data":"c2a8d9114c992437608c2909a133123f645742a0f1e6ab8eb42f7745aed8b2be"} Jun 08 15:45:18.501618 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:18.501582 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjxlc" event={"ID":"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f","Type":"ContainerStarted","Data":"ae138cb4af006535f210f8b4c94baa2b24bc4e8dc2596baaa9e6128ce3776af2"} Jun 08 15:45:18.501987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:18.501645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjxlc" event={"ID":"fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f","Type":"ContainerStarted","Data":"b7872ee2e5eb76db41a34133add5ef8ea21f81287d9d435c2fc80fed44825140"} Jun 08 15:45:18.532250 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:18.532199 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vjxlc" podStartSLOduration=3.744417251 podStartE2EDuration="4.532184747s" totalImagesPullingTime="723.53305ms" totalInitContainerRuntime="64.234446ms" isStatefulPod=true podCreationTimestamp="2026-06-08 15:45:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:18.531702489 +0000 UTC m=+267.362641867" watchObservedRunningTime="2026-06-08 15:45:18.532184747 +0000 UTC m=+267.363124151" Jun 08 15:45:19.794651 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.794614 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7465c4c948-br499"] Jun 08 15:45:19.796918 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.796901 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.799373 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.799351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 15:45:19.799373 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.799361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hgxd5\"" Jun 08 15:45:19.799581 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.799428 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 15:45:19.799581 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.799437 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 15:45:19.800042 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.799993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 15:45:19.800190 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.800071 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 15:45:19.806912 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.806889 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 15:45:19.811605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.811573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7465c4c948-br499"] Jun 08 15:45:19.843471 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843471 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843666 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-federate-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843666 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843568 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-serving-certs-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843666 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843758 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843758 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-metrics-client-ca\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.843758 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.843706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzh4v\" (UniqueName: \"kubernetes.io/projected/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-kube-api-access-tzh4v\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944294 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944294 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-federate-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-serving-certs-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-metrics-client-ca\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.944539 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.944433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzh4v\" (UniqueName: \"kubernetes.io/projected/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-kube-api-access-tzh4v\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.945322 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.945299 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-metrics-client-ca\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.945413 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.945303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-serving-certs-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.945472 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.945419 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.947008 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.946983 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.947192 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.947171 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-federate-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.947239 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.947195 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-telemeter-client-tls\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.947287 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.947272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-secret-telemeter-client\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:19.953961 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:19.953943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzh4v\" (UniqueName: \"kubernetes.io/projected/4fb63cc2-986e-4e9b-a4a2-cc439e22d565-kube-api-access-tzh4v\") pod \"telemeter-client-7465c4c948-br499\" (UID: \"4fb63cc2-986e-4e9b-a4a2-cc439e22d565\") " pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:20.107281 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.107247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" Jun 08 15:45:20.236370 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.236327 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7465c4c948-br499"] Jun 08 15:45:20.239781 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:20.239751 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb63cc2_986e_4e9b_a4a2_cc439e22d565.slice/crio-ad466af0510b66476171f49dc46758831cad63f272f636e3aaedc07b9d33c803 WatchSource:0}: Error finding container ad466af0510b66476171f49dc46758831cad63f272f636e3aaedc07b9d33c803: Status 404 returned error can't find the container with id ad466af0510b66476171f49dc46758831cad63f272f636e3aaedc07b9d33c803 Jun 08 15:45:20.512626 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.512527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" event={"ID":"4fb63cc2-986e-4e9b-a4a2-cc439e22d565","Type":"ContainerStarted","Data":"ad466af0510b66476171f49dc46758831cad63f272f636e3aaedc07b9d33c803"} Jun 08 15:45:20.743282 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.743249 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:45:20.746048 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.746018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.748648 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.748626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 15:45:20.748753 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.748657 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 15:45:20.748826 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.748789 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 15:45:20.749407 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.749383 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 15:45:20.749527 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.749448 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 15:45:20.749715 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.749701 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 15:45:20.750049 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750032 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hp8lg\"" Jun 08 15:45:20.750123 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 15:45:20.750372 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750352 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6umog33vng9vu\"" Jun 08 15:45:20.750372 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750364 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 15:45:20.750501 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750375 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 15:45:20.750501 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750378 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 15:45:20.750581 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750525 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 15:45:20.750740 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750723 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 15:45:20.750808 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750781 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 15:45:20.750876 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.750725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 15:45:20.753288 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.753267 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 15:45:20.764585 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.764523 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:45:20.852020 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.851971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852020 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bl9n\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852206 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.852517 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.853006 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852480 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.853006 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.852529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953295 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953295 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953295 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953584 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953584 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953584 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953738 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953738 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953738 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953738 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bl9n\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953887 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.953962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954172 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.953977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954172 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954172 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954172 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954202 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.954558 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.954466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.955041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.955015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.957031 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957011 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.957825 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957366 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.957825 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.957825 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957755 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.957825 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957781 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.958093 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.958093 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957971 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.958093 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.957975 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.959237 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.959175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.959925 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.959900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.960234 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.960209 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.960905 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.960883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.961009 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.960883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.961104 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.961081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.962906 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.962884 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:20.965510 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:20.965491 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bl9n\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n\") pod \"prometheus-k8s-0\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:21.057909 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:21.057803 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:21.205656 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:21.205622 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:45:21.208533 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:21.208512 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3c7100_904c_4d4b_93d0_5e08eb6d8082.slice/crio-32954579db89e5b1bf90073acaa3cfbaabc59b817da04590c4d481c22360442f WatchSource:0}: Error finding container 32954579db89e5b1bf90073acaa3cfbaabc59b817da04590c4d481c22360442f: Status 404 returned error can't find the container with id 32954579db89e5b1bf90073acaa3cfbaabc59b817da04590c4d481c22360442f Jun 08 15:45:21.517436 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:21.517398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"32954579db89e5b1bf90073acaa3cfbaabc59b817da04590c4d481c22360442f"} Jun 08 15:45:22.526232 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:22.525692 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" event={"ID":"4fb63cc2-986e-4e9b-a4a2-cc439e22d565","Type":"ContainerStarted","Data":"a6d5c2af077a5b2e14e482992596d0ff7f0614ce1bd9607254246ac186ca6e6e"} Jun 08 15:45:22.528927 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:22.528865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c"} Jun 08 15:45:23.534598 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:23.534560 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" event={"ID":"4fb63cc2-986e-4e9b-a4a2-cc439e22d565","Type":"ContainerStarted","Data":"05e313ab3bae08681ef29d03e87340b63019e33a85bc5038b57a360eaa12951c"} Jun 08 15:45:23.535027 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:23.534632 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" event={"ID":"4fb63cc2-986e-4e9b-a4a2-cc439e22d565","Type":"ContainerStarted","Data":"d155954b66d15bfb895a6772163414096bad4a3fd6088dc28e63c0ab42d7c6ad"} Jun 08 15:45:23.536030 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:23.536008 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c" exitCode=0 Jun 08 15:45:23.536125 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:23.536080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c"} Jun 08 15:45:23.560845 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:23.560785 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7465c4c948-br499" podStartSLOduration=2.3666114670000002 podStartE2EDuration="4.560769367s" totalImagesPullingTime="2.1941579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:23.560242008 +0000 UTC m=+272.391181386" watchObservedRunningTime="2026-06-08 15:45:23.560769367 +0000 UTC m=+272.391708744" Jun 08 15:45:26.552494 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:26.552403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c"} Jun 08 15:45:26.552862 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:26.552515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81"} Jun 08 15:45:28.562320 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:28.562286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099"} Jun 08 15:45:28.562819 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:28.562348 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7"} Jun 08 15:45:28.562819 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:28.562373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b"} Jun 08 15:45:28.562819 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:28.562399 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerStarted","Data":"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105"} Jun 08 15:45:28.593924 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:28.593869 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9979300760000003 podStartE2EDuration="8.593849556s" totalImagesPullingTime="5.56717633s" totalInitContainerRuntime="28.74315ms" isStatefulPod=false podCreationTimestamp="2026-06-08 15:45:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:28.59127285 +0000 UTC m=+277.422212241" watchObservedRunningTime="2026-06-08 15:45:28.593849556 +0000 UTC m=+277.424788926" Jun 08 15:45:31.058925 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:31.058879 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:45:33.183553 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:33.183509 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vclk7" podUID="11fd30a2-4d8d-47f3-9453-173f94d297ce" Jun 08 15:45:33.580048 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:33.579970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:36.494410 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:36.494357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:36.496636 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:36.496615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11fd30a2-4d8d-47f3-9453-173f94d297ce-metrics-tls\") pod \"dns-default-vclk7\" (UID: \"11fd30a2-4d8d-47f3-9453-173f94d297ce\") " pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:36.583614 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:36.583581 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db5c2\"" Jun 08 15:45:36.591144 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:36.591121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:36.715040 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:36.714973 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vclk7"] Jun 08 15:45:36.717372 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:45:36.717346 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fd30a2_4d8d_47f3_9453_173f94d297ce.slice/crio-3bce3b792e46ce0193fc87bff7f154afccf74350ed067bbda9b90ba70bb3f102 WatchSource:0}: Error finding container 3bce3b792e46ce0193fc87bff7f154afccf74350ed067bbda9b90ba70bb3f102: Status 404 returned error can't find the container with id 3bce3b792e46ce0193fc87bff7f154afccf74350ed067bbda9b90ba70bb3f102 Jun 08 15:45:37.596665 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:37.596632 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vclk7" event={"ID":"11fd30a2-4d8d-47f3-9453-173f94d297ce","Type":"ContainerStarted","Data":"3bce3b792e46ce0193fc87bff7f154afccf74350ed067bbda9b90ba70bb3f102"} Jun 08 15:45:38.602519 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:38.602485 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vclk7" event={"ID":"11fd30a2-4d8d-47f3-9453-173f94d297ce","Type":"ContainerStarted","Data":"4318d2359cc08de82bfeefb964ae97f37327e6def586cb14663247749d36c252"} Jun 08 15:45:38.603034 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:38.602542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vclk7" event={"ID":"11fd30a2-4d8d-47f3-9453-173f94d297ce","Type":"ContainerStarted","Data":"2c5f672c4a6039d0210cc35e98368ec2182d532aee65e8faa76d3041ca980fae"} Jun 08 15:45:38.603034 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:38.602627 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:38.621235 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:38.621182 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vclk7" podStartSLOduration=251.155749009 podStartE2EDuration="4m12.621166299s" totalImagesPullingTime="1.46541729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 15:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:45:38.619903716 +0000 UTC m=+287.450843085" watchObservedRunningTime="2026-06-08 15:45:38.621166299 +0000 UTC m=+287.452105677" Jun 08 15:45:41.894299 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:41.894252 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" podUID="97186960-c69f-470b-a6dd-a55c2476e032" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:45:48.608761 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:48.608729 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vclk7" Jun 08 15:45:49.644770 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:49.644686 2577 generic.go:356] "Generic (PLEG): container finished" podID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" containerID="bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602" exitCode=1 Jun 08 15:45:49.644770 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:49.644729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerDied","Data":"bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602"} Jun 08 15:45:49.645202 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:49.644772 2577 scope.go:117] "RemoveContainer" containerID="5c04dead3c6c38de13d5e747b0ce20d941e221591fe461b9ffb29705d7384af7" Jun 08 15:45:49.645202 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:49.645071 2577 scope.go:117] "RemoveContainer" containerID="bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602" Jun 08 15:45:49.645272 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:49.645235 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-74bfc76987-9stqm_open-cluster-management-agent-addon(36d363ff-b98b-4fe4-9383-b84f2c97e2a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" podUID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" Jun 08 15:45:50.241150 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:50.241116 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:45:50.649203 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:50.649179 2577 scope.go:117] "RemoveContainer" containerID="bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602" Jun 08 15:45:50.649591 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:50.649336 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-74bfc76987-9stqm_open-cluster-management-agent-addon(36d363ff-b98b-4fe4-9383-b84f2c97e2a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" podUID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" Jun 08 15:45:51.606038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:51.606013 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 15:45:51.861890 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:51.861797 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:45:51.864171 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:51.862208 2577 scope.go:117] "RemoveContainer" containerID="bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602" Jun 08 15:45:51.864171 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:45:51.862365 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-74bfc76987-9stqm_open-cluster-management-agent-addon(36d363ff-b98b-4fe4-9383-b84f2c97e2a2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" podUID="36d363ff-b98b-4fe4-9383-b84f2c97e2a2" Jun 08 15:45:51.893805 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:45:51.893761 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" podUID="97186960-c69f-470b-a6dd-a55c2476e032" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:46:01.894458 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:01.894414 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" podUID="97186960-c69f-470b-a6dd-a55c2476e032" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 15:46:01.894832 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:01.894494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" Jun 08 15:46:01.895013 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:01.894984 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"061586ab1069117a5a777cb4e2153b845ee1610af64c5b50965a5d510e7fd507"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 15:46:01.895048 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:01.895033 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" podUID="97186960-c69f-470b-a6dd-a55c2476e032" containerName="service-proxy" containerID="cri-o://061586ab1069117a5a777cb4e2153b845ee1610af64c5b50965a5d510e7fd507" gracePeriod=30 Jun 08 15:46:02.660776 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:02.660744 2577 scope.go:117] "RemoveContainer" containerID="bae3bc9ecaac6b77e82bc531823291c9198d55145c7686549a7783a724629602" Jun 08 15:46:02.692888 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:02.692851 2577 generic.go:356] "Generic (PLEG): container finished" podID="97186960-c69f-470b-a6dd-a55c2476e032" containerID="061586ab1069117a5a777cb4e2153b845ee1610af64c5b50965a5d510e7fd507" exitCode=2 Jun 08 15:46:02.692888 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:02.692864 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerDied","Data":"061586ab1069117a5a777cb4e2153b845ee1610af64c5b50965a5d510e7fd507"} Jun 08 15:46:02.693116 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:02.692911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c9f4fbfc7-g9mkw" event={"ID":"97186960-c69f-470b-a6dd-a55c2476e032","Type":"ContainerStarted","Data":"d63da45f61f82e2b97f77300cd7e36757deb41dac6ebf2a10e886876d868d82e"} Jun 08 15:46:03.697568 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:03.697530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" event={"ID":"36d363ff-b98b-4fe4-9383-b84f2c97e2a2","Type":"ContainerStarted","Data":"e856533aa0639036be2c2ce6d6af49326b79f4c3c8758a60a4b56426836fa3b3"} Jun 08 15:46:03.697963 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:03.697802 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:46:03.699409 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:03.699390 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74bfc76987-9stqm" Jun 08 15:46:08.858143 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:08.858111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lqhm_252d42b7-6b92-4516-a2db-d0141a60d2d6/serve-healthcheck-canary/0.log" Jun 08 15:46:21.058228 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:21.058190 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:21.082962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:21.082934 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:21.774421 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:21.774391 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:39.200876 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.200780 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201093 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="prometheus" containerID="cri-o://8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81" gracePeriod=600 Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201120 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-web" containerID="cri-o://184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b" gracePeriod=600 Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201137 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="thanos-sidecar" containerID="cri-o://8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105" gracePeriod=600 Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201163 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-thanos" containerID="cri-o://52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099" gracePeriod=600 Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201095 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy" containerID="cri-o://7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7" gracePeriod=600 Jun 08 15:46:39.201360 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.201157 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="config-reloader" containerID="cri-o://f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c" gracePeriod=600 Jun 08 15:46:39.266187 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:39.266153 2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3c7100_904c_4d4b_93d0_5e08eb6d8082.slice/crio-52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3c7100_904c_4d4b_93d0_5e08eb6d8082.slice/crio-conmon-52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099.scope\": RecentStats: unable to find data in memory cache]" Jun 08 15:46:39.830312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830271 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099" exitCode=0 Jun 08 15:46:39.830312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830309 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7" exitCode=0 Jun 08 15:46:39.830312 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830319 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105" exitCode=0 Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830328 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c" exitCode=0 Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830336 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81" exitCode=0 Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099"} Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7"} Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830488 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105"} Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c"} Jun 08 15:46:39.830605 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:39.830565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81"} Jun 08 15:46:40.443282 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.443261 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.588495 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588465 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588502 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588523 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588555 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588578 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588604 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588650 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588632 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588662 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588744 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588770 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588803 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588833 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588880 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588908 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.588962 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588937 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588965 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.588990 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589015 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bl9n\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589038 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file\") pod \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\" (UID: \"ca3c7100-904c-4d4b-93d0-5e08eb6d8082\") " Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589041 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589053 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589162 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589353 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.589377 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589374 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.589859 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.589391 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.590203 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.590176 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.590771 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.590509 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.590771 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.590570 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.591281 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.591228 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 15:46:40.591536 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.591509 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.591741 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.591715 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:46:40.591815 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.591751 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.592086 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.592028 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config" (OuterVolumeSpecName: "config") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.592469 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.592431 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.592556 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.592530 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:46:40.593342 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.593310 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.593665 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.593606 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out" (OuterVolumeSpecName: "config-out") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 15:46:40.593761 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.593716 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.594367 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.594339 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.594367 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.594355 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.594484 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.594378 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n" (OuterVolumeSpecName: "kube-api-access-9bl9n") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "kube-api-access-9bl9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 15:46:40.602053 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.602027 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config" (OuterVolumeSpecName: "web-config") pod "ca3c7100-904c-4d4b-93d0-5e08eb6d8082" (UID: "ca3c7100-904c-4d4b-93d0-5e08eb6d8082"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 15:46:40.689811 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689776 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-metrics-client-certs\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.689811 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689803 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-grpc-tls\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689858 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-web-config\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689867 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-kube-rbac-proxy\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689877 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689886 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-tls-assets\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689894 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689903 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config-out\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689913 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-db\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689922 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689931 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689939 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689947 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-configmap-metrics-client-ca\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689958 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bl9n\" (UniqueName: \"kubernetes.io/projected/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-kube-api-access-9bl9n\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689967 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689974 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.690028 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.689982 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca3c7100-904c-4d4b-93d0-5e08eb6d8082-config\") on node \"ip-10-0-128-38.ec2.internal\" DevicePath \"\"" Jun 08 15:46:40.837017 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.836980 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerID="184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b" exitCode=0 Jun 08 15:46:40.837169 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.837061 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.837169 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.837057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b"} Jun 08 15:46:40.837305 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.837199 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca3c7100-904c-4d4b-93d0-5e08eb6d8082","Type":"ContainerDied","Data":"32954579db89e5b1bf90073acaa3cfbaabc59b817da04590c4d481c22360442f"} Jun 08 15:46:40.837305 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.837235 2577 scope.go:117] "RemoveContainer" containerID="52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099" Jun 08 15:46:40.844591 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.844571 2577 scope.go:117] "RemoveContainer" containerID="7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7" Jun 08 15:46:40.851363 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.851345 2577 scope.go:117] "RemoveContainer" containerID="184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b" Jun 08 15:46:40.858606 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.858589 2577 scope.go:117] "RemoveContainer" containerID="8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105" Jun 08 15:46:40.864947 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.864926 2577 scope.go:117] "RemoveContainer" containerID="f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c" Jun 08 15:46:40.871286 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.871264 2577 scope.go:117] "RemoveContainer" containerID="8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81" Jun 08 15:46:40.873326 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.873304 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:40.878524 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.878507 2577 scope.go:117] "RemoveContainer" containerID="b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c" Jun 08 15:46:40.883678 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.883657 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:40.885327 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.885312 2577 scope.go:117] "RemoveContainer" containerID="52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099" Jun 08 15:46:40.885600 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.885581 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099\": container with ID starting with 52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099 not found: ID does not exist" containerID="52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099" Jun 08 15:46:40.885643 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.885611 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099"} err="failed to get container status \"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099\": rpc error: code = NotFound desc = could not find container \"52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099\": container with ID starting with 52e2e9b5b775a9d9f2e0fa82c006266f0dd3abe0cc2a017cd26bbbd016c54099 not found: ID does not exist" Jun 08 15:46:40.885643 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.885629 2577 scope.go:117] "RemoveContainer" containerID="7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7" Jun 08 15:46:40.885885 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.885866 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7\": container with ID starting with 7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7 not found: ID does not exist" containerID="7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7" Jun 08 15:46:40.885987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.885885 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7"} err="failed to get container status \"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7\": rpc error: code = NotFound desc = could not find container \"7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7\": container with ID starting with 7ad7f0bb234e460edd4cc530ea906bc4ad6b05d51763cb47d92122379ccc7db7 not found: ID does not exist" Jun 08 15:46:40.885987 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.885899 2577 scope.go:117] "RemoveContainer" containerID="184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b" Jun 08 15:46:40.886141 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.886126 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b\": container with ID starting with 184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b not found: ID does not exist" containerID="184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b" Jun 08 15:46:40.886178 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886143 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b"} err="failed to get container status \"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b\": rpc error: code = NotFound desc = could not find container \"184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b\": container with ID starting with 184e4f740ad0e7062840938c35c2495761b0167f6dc78e4c06c2180360646b9b not found: ID does not exist" Jun 08 15:46:40.886178 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886157 2577 scope.go:117] "RemoveContainer" containerID="8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105" Jun 08 15:46:40.886352 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.886335 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105\": container with ID starting with 8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105 not found: ID does not exist" containerID="8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105" Jun 08 15:46:40.886393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886354 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105"} err="failed to get container status \"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105\": rpc error: code = NotFound desc = could not find container \"8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105\": container with ID starting with 8e9cfe98de934db93bb89aff1cd10b406a4626f38818ed88d0a2f571d9bbe105 not found: ID does not exist" Jun 08 15:46:40.886393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886366 2577 scope.go:117] "RemoveContainer" containerID="f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c" Jun 08 15:46:40.886564 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.886547 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c\": container with ID starting with f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c not found: ID does not exist" containerID="f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c" Jun 08 15:46:40.886601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886568 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c"} err="failed to get container status \"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c\": rpc error: code = NotFound desc = could not find container \"f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c\": container with ID starting with f141504f14aa20e6a43e043488c164918e379f9980759779d5eb7b3aa947567c not found: ID does not exist" Jun 08 15:46:40.886601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886579 2577 scope.go:117] "RemoveContainer" containerID="8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81" Jun 08 15:46:40.886805 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.886788 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81\": container with ID starting with 8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81 not found: ID does not exist" containerID="8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81" Jun 08 15:46:40.886864 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886806 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81"} err="failed to get container status \"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81\": rpc error: code = NotFound desc = could not find container \"8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81\": container with ID starting with 8895b121c5239cde0eb339ea8a4419d26e674ce3782b8ff5334ca4c4c098da81 not found: ID does not exist" Jun 08 15:46:40.886864 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.886818 2577 scope.go:117] "RemoveContainer" containerID="b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c" Jun 08 15:46:40.887053 ip-10-0-128-38 kubenswrapper[2577]: E0608 15:46:40.887039 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c\": container with ID starting with b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c not found: ID does not exist" containerID="b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c" Jun 08 15:46:40.887100 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.887055 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c"} err="failed to get container status \"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c\": rpc error: code = NotFound desc = could not find container \"b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c\": container with ID starting with b6b86058b1e7486d39459318628285f2a40addc16aaf9f4e21d2256b27b6079c not found: ID does not exist" Jun 08 15:46:40.924482 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924451 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:40.924699 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924688 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="prometheus" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924700 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="prometheus" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924710 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="config-reloader" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924716 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="config-reloader" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924722 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-thanos" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924728 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-thanos" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924736 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-web" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924741 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-web" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924747 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="thanos-sidecar" Jun 08 15:46:40.924746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924752 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="thanos-sidecar" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924766 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924771 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924777 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="init-config-reloader" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924783 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="init-config-reloader" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924823 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="prometheus" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924830 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-thanos" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924849 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="thanos-sidecar" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924856 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="config-reloader" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924861 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy-web" Jun 08 15:46:40.925038 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.924866 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" containerName="kube-rbac-proxy" Jun 08 15:46:40.930807 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.930791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.938809 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.938791 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 15:46:40.939503 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.939488 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 15:46:40.939561 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.939503 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 15:46:40.939761 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.939745 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 15:46:40.939870 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.939751 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hp8lg\"" Jun 08 15:46:40.940018 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.940005 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6umog33vng9vu\"" Jun 08 15:46:40.940061 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.940034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 15:46:40.942959 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.942943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 15:46:40.943026 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.942969 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 15:46:40.943321 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.943303 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 15:46:40.943407 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.943327 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 15:46:40.944204 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.944192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 15:46:40.944259 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.944196 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 15:46:40.952322 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.952302 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 15:46:40.954174 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.954159 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 15:46:40.955556 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.955541 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 15:46:40.955797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.955783 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 15:46:40.977014 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.976985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:40.992108 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992207 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992207 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992207 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992222 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992336 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992393 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xns\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-kube-api-access-c6xns\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992684 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:40.992922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:40.992689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.093954 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.093915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.093954 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.093950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.093971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.093986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xns\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-kube-api-access-c6xns\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094031 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.094797 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094664 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.095223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.094938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.095223 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.095137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.095340 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.095320 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.096116 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.095999 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.097638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-web-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.098922 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.098904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099225 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eb1cd180-d671-46c8-a352-d195ffde5bfc-config-out\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099225 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099321 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099533 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099515 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-config\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099601 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099657 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099625 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eb1cd180-d671-46c8-a352-d195ffde5bfc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.099703 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.099660 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eb1cd180-d671-46c8-a352-d195ffde5bfc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.105316 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.105298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xns\" (UniqueName: \"kubernetes.io/projected/eb1cd180-d671-46c8-a352-d195ffde5bfc-kube-api-access-c6xns\") pod \"prometheus-k8s-0\" (UID: \"eb1cd180-d671-46c8-a352-d195ffde5bfc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.239746 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.239707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:46:41.385979 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.385955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 15:46:41.387013 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:46:41.386977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1cd180_d671_46c8_a352_d195ffde5bfc.slice/crio-765f4f9f09f8efae6d62514e9c2c7735566da2d3ed204e36fdbe6fd64809a5cb WatchSource:0}: Error finding container 765f4f9f09f8efae6d62514e9c2c7735566da2d3ed204e36fdbe6fd64809a5cb: Status 404 returned error can't find the container with id 765f4f9f09f8efae6d62514e9c2c7735566da2d3ed204e36fdbe6fd64809a5cb Jun 08 15:46:41.664808 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.664726 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3c7100-904c-4d4b-93d0-5e08eb6d8082" path="/var/lib/kubelet/pods/ca3c7100-904c-4d4b-93d0-5e08eb6d8082/volumes" Jun 08 15:46:41.842113 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.842082 2577 generic.go:356] "Generic (PLEG): container finished" podID="eb1cd180-d671-46c8-a352-d195ffde5bfc" containerID="d8cd643e5104674c01bcbad8353bc2255ed3db531d9606f073bd6c6b8fd87978" exitCode=0 Jun 08 15:46:41.842264 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.842178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerDied","Data":"d8cd643e5104674c01bcbad8353bc2255ed3db531d9606f073bd6c6b8fd87978"} Jun 08 15:46:41.842264 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:41.842257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"765f4f9f09f8efae6d62514e9c2c7735566da2d3ed204e36fdbe6fd64809a5cb"} Jun 08 15:46:42.849432 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"e9b6b44d255b534910bad8f216c6884a11304c292c74e8c82d6335c48e77569c"} Jun 08 15:46:42.849827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"ea434c3e211fa2a7e4419e41ef9b1fc68365bd93690eb61a20e583de8234d06f"} Jun 08 15:46:42.849827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"e8c7328629d1e37e27a17469089dda0a497c495b7464f282e41e2b67999bb406"} Jun 08 15:46:42.849827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"9775fd0ddbcf0e1c7926db296715310aa2eaf9e8a013ae09b3aa6fb8c1f3d525"} Jun 08 15:46:42.849827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849595 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"7502dcbbd5cd784556f6ecc0031d02cd1baf0745c94847b20923c6650704819b"} Jun 08 15:46:42.849827 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.849619 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eb1cd180-d671-46c8-a352-d195ffde5bfc","Type":"ContainerStarted","Data":"1ebb7093693105fb3acdd9d37bb5ed3772f6bd2543e2e321c1e9f2bbf4132811"} Jun 08 15:46:42.884607 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:42.884545 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.861602043 podStartE2EDuration="2.884525829s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.923786ms" isStatefulPod=false podCreationTimestamp="2026-06-08 15:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:46:42.881742968 +0000 UTC m=+351.712682347" watchObservedRunningTime="2026-06-08 15:46:42.884525829 +0000 UTC m=+351.715465208" Jun 08 15:46:46.240860 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:46:46.240798 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:47:41.240186 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:47:41.240147 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:47:41.255396 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:47:41.255369 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:47:42.072445 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:47:42.072414 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 15:48:01.727042 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:01.727001 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6b2tx_40552af1-61fc-4ba5-9eb5-4ae02f7f3cab/global-pull-secret-syncer/0.log" Jun 08 15:48:01.728763 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:01.728733 2577 ???:1] "http: TLS handshake error from 10.0.128.38:44708: EOF" Jun 08 15:48:02.053083 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:02.052999 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q55cx_418707b8-a008-48a7-ba13-85b8e144fd90/konnectivity-agent/0.log" Jun 08 15:48:02.191689 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:02.191661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-38.ec2.internal_0ed7c9a934fd45d5df80522620ae23db/haproxy/0.log" Jun 08 15:48:07.706470 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:07.706399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjxlc_fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f/node-exporter/0.log" Jun 08 15:48:07.777981 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:07.777951 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjxlc_fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f/kube-rbac-proxy/0.log" Jun 08 15:48:07.833832 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:07.833806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjxlc_fc96a3ad-91e8-40dd-8a4a-8405fa8ea72f/init-textfile/0.log" Jun 08 15:48:07.889886 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:07.889851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-f587d_791108c9-1a99-41a3-97bd-4c22461a4391/kube-rbac-proxy-main/0.log" Jun 08 15:48:07.973044 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:07.972963 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-f587d_791108c9-1a99-41a3-97bd-4c22461a4391/kube-rbac-proxy-self/0.log" Jun 08 15:48:08.058904 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.058865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-f587d_791108c9-1a99-41a3-97bd-4c22461a4391/openshift-state-metrics/0.log" Jun 08 15:48:08.144361 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.144334 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/prometheus/0.log" Jun 08 15:48:08.222023 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.221982 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/config-reloader/0.log" Jun 08 15:48:08.264281 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.264195 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/thanos-sidecar/0.log" Jun 08 15:48:08.305241 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.305214 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/kube-rbac-proxy-web/0.log" Jun 08 15:48:08.396127 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.396086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/kube-rbac-proxy/0.log" Jun 08 15:48:08.468274 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.468233 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/kube-rbac-proxy-thanos/0.log" Jun 08 15:48:08.569374 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.569297 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eb1cd180-d671-46c8-a352-d195ffde5bfc/init-config-reloader/0.log" Jun 08 15:48:08.874609 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.874571 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b"] Jun 08 15:48:08.877911 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.877889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:08.888130 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.888110 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kp7pn\"/\"kube-root-ca.crt\"" Jun 08 15:48:08.890034 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.890019 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kp7pn\"/\"openshift-service-ca.crt\"" Jun 08 15:48:08.890128 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.890109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kp7pn\"/\"default-dockercfg-dq9zh\"" Jun 08 15:48:08.900823 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.900793 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7465c4c948-br499_4fb63cc2-986e-4e9b-a4a2-cc439e22d565/telemeter-client/0.log" Jun 08 15:48:08.901703 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.901680 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b"] Jun 08 15:48:08.904010 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.903988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-podres\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:08.904131 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.904019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-proc\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:08.904131 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.904097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-sys\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:08.904228 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.904140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9j9\" (UniqueName: \"kubernetes.io/projected/caa9dd84-af19-4244-afd0-28de722a0885-kube-api-access-2v9j9\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:08.904228 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:08.904173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-lib-modules\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005270 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-lib-modules\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005270 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-podres\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-proc\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-sys\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9j9\" (UniqueName: \"kubernetes.io/projected/caa9dd84-af19-4244-afd0-28de722a0885-kube-api-access-2v9j9\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-lib-modules\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005391 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-proc\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005382 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-podres\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.005490 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.005418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caa9dd84-af19-4244-afd0-28de722a0885-sys\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.018354 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.018330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7465c4c948-br499_4fb63cc2-986e-4e9b-a4a2-cc439e22d565/reload/0.log" Jun 08 15:48:09.026523 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.026499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9j9\" (UniqueName: \"kubernetes.io/projected/caa9dd84-af19-4244-afd0-28de722a0885-kube-api-access-2v9j9\") pod \"perf-node-gather-daemonset-2nq6b\" (UID: \"caa9dd84-af19-4244-afd0-28de722a0885\") " pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.088306 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.088282 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7465c4c948-br499_4fb63cc2-986e-4e9b-a4a2-cc439e22d565/kube-rbac-proxy/0.log" Jun 08 15:48:09.186654 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.186568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:09.316243 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:09.316214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b"] Jun 08 15:48:09.318704 ip-10-0-128-38 kubenswrapper[2577]: W0608 15:48:09.318672 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcaa9dd84_af19_4244_afd0_28de722a0885.slice/crio-b37c63cf803e6cf9d3b57b9b534e6889d4f42714cd47c10a31f1a8062592b111 WatchSource:0}: Error finding container b37c63cf803e6cf9d3b57b9b534e6889d4f42714cd47c10a31f1a8062592b111: Status 404 returned error can't find the container with id b37c63cf803e6cf9d3b57b9b534e6889d4f42714cd47c10a31f1a8062592b111 Jun 08 15:48:10.154604 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:10.154565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" event={"ID":"caa9dd84-af19-4244-afd0-28de722a0885","Type":"ContainerStarted","Data":"28b7cc5a72f3d03741a5e502af0b9851f9c9c98cf86a3ee2858f7cb720e638cb"} Jun 08 15:48:10.155100 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:10.154655 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" event={"ID":"caa9dd84-af19-4244-afd0-28de722a0885","Type":"ContainerStarted","Data":"b37c63cf803e6cf9d3b57b9b534e6889d4f42714cd47c10a31f1a8062592b111"} Jun 08 15:48:10.155100 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:10.154709 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:10.178766 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:10.178715 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" podStartSLOduration=2.178700701 podStartE2EDuration="2.178700701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 15:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 15:48:10.17811013 +0000 UTC m=+439.009049518" watchObservedRunningTime="2026-06-08 15:48:10.178700701 +0000 UTC m=+439.009640079" Jun 08 15:48:13.283283 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:13.283250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vclk7_11fd30a2-4d8d-47f3-9453-173f94d297ce/dns/0.log" Jun 08 15:48:13.335609 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:13.335581 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vclk7_11fd30a2-4d8d-47f3-9453-173f94d297ce/kube-rbac-proxy/0.log" Jun 08 15:48:13.489427 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:13.489403 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sspcd_2fb649b9-be07-4e2d-a619-a4370187c94a/dns-node-resolver/0.log" Jun 08 15:48:14.331924 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:14.331897 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gsmxf_ecfab48c-0d30-4b7d-bfa6-da966c41a559/node-ca/0.log" Jun 08 15:48:15.676495 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:15.676470 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4lqhm_252d42b7-6b92-4516-a2db-d0141a60d2d6/serve-healthcheck-canary/0.log" Jun 08 15:48:16.167726 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:16.167699 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kp7pn/perf-node-gather-daemonset-2nq6b" Jun 08 15:48:16.443226 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:16.443146 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9sclq_6c8776e2-15ed-4bbf-a87f-b00cc86c8050/kube-rbac-proxy/0.log" Jun 08 15:48:16.473683 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:16.473655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9sclq_6c8776e2-15ed-4bbf-a87f-b00cc86c8050/exporter/0.log" Jun 08 15:48:16.508161 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:16.508138 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9sclq_6c8776e2-15ed-4bbf-a87f-b00cc86c8050/extractor/0.log" Jun 08 15:48:24.095436 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.095411 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/kube-multus-additional-cni-plugins/0.log" Jun 08 15:48:24.148748 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.148723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/egress-router-binary-copy/0.log" Jun 08 15:48:24.188232 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.188202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/cni-plugins/0.log" Jun 08 15:48:24.234041 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.234008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/bond-cni-plugin/0.log" Jun 08 15:48:24.266268 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.266241 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/routeoverride-cni/0.log" Jun 08 15:48:24.299310 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.299284 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/whereabouts-cni-bincopy/0.log" Jun 08 15:48:24.329622 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.329592 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hz6t9_3d28b837-6d9e-43fb-aaa0-60aae2c7a440/whereabouts-cni/0.log" Jun 08 15:48:24.635452 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.635423 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kzvz9_b33bd503-0fb2-495e-94af-f6f1f56a6463/kube-multus/0.log" Jun 08 15:48:24.908225 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.908197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcmxg_cc87851b-dc81-46b1-b67b-0e1768fe11dc/network-metrics-daemon/0.log" Jun 08 15:48:24.939430 ip-10-0-128-38 kubenswrapper[2577]: I0608 15:48:24.939399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qcmxg_cc87851b-dc81-46b1-b67b-0e1768fe11dc/kube-rbac-proxy/0.log"