Jun 09 11:52:18.662190 ip-10-0-129-85 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 11:52:18.662201 ip-10-0-129-85 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 11:52:18.662210 ip-10-0-129-85 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 11:52:18.662524 ip-10-0-129-85 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 11:52:29.872349 ip-10-0-129-85 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 09 11:52:29.872363 ip-10-0-129-85 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aebb1247f3454b5fbe68cceed46fb0f2 -- Jun 09 11:54:45.961972 ip-10-0-129-85 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:54:46.394596 ip-10-0-129-85 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:46.394596 ip-10-0-129-85 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:54:46.394596 ip-10-0-129-85 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:46.394596 ip-10-0-129-85 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:54:46.394596 ip-10-0-129-85 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:46.395745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.395624 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:54:46.400802 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400787 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.400802 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400800 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400806 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400810 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400814 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400821 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400825 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400828 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400831 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400833 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400836 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400839 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400841 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400844 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400847 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400849 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400853 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400857 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400860 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.400862 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400863 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400866 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400869 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400872 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400875 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400878 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400880 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400883 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400885 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400888 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400891 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400893 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400896 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400898 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400901 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400903 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400906 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400909 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400912 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400915 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.401369 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400918 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400921 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400923 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400926 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400928 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400931 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400933 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400936 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400939 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400941 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400944 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400946 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400949 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400951 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400956 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400959 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400961 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400964 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400967 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400970 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.402122 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400973 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400975 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400978 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400980 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400983 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400985 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400988 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400990 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400993 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400996 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.400998 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401001 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401004 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401007 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401010 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401013 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401015 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401018 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401020 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401024 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.402711 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401026 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401029 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401031 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401034 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401037 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401040 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401043 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401046 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401049 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401051 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401054 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401057 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401059 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401063 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401066 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401069 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401072 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401075 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401078 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.403204 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.401081 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.406199 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406183 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.406199 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406200 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406203 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406206 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406210 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406213 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406216 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406219 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406222 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406225 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406227 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406231 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406233 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406236 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406239 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406242 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406244 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406247 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406250 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406253 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406257 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.406261 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406261 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406264 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406267 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406270 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406274 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406277 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406282 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406285 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406288 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406290 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406293 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406296 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406298 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406301 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406303 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406306 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406309 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406311 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406314 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406316 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.406811 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406319 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406321 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406325 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406329 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406331 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406334 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406337 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406340 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406342 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406345 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406348 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406351 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406353 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406356 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406359 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406362 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406364 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406371 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406374 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406377 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.407301 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406379 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406382 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406384 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406387 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406390 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406392 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406395 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406397 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406400 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406404 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406406 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406409 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406412 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406415 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406420 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406422 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406425 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406428 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406431 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.407823 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406434 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406436 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406439 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406442 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406445 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406447 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406450 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406453 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406455 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406458 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406461 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406463 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406466 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406468 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406471 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406473 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406476 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406479 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406481 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406863 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.408297 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406868 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406871 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406873 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406877 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406880 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406882 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406885 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406888 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406890 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406893 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406896 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406898 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406901 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406904 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406907 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406910 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406913 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406916 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406919 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406922 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.408795 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406924 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406927 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406930 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406932 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406935 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406937 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406940 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406943 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406945 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406948 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406950 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406953 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406955 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406958 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406960 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406963 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406965 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406968 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406970 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406973 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406975 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.409274 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406978 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406980 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406983 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406985 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406988 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406991 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406994 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.406997 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407000 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407003 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407005 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407008 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407010 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407013 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407015 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407018 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407021 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407024 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407027 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407029 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.409800 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407032 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407035 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407037 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407041 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407043 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407046 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407048 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407051 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407055 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407059 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407063 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407066 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407070 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407074 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407077 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407080 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407084 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407087 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407090 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.410290 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407092 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407096 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407099 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407101 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407104 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407107 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407109 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407112 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407114 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407117 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407119 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407122 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407124 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407127 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407129 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407132 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407135 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407137 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407221 2550 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407231 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:54:46.410784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407241 2550 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407247 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407254 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407258 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407262 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407267 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407270 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407274 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407277 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407281 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407285 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407288 2550 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407291 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407294 2550 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407297 2550 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407301 2550 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407305 2550 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407309 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407312 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407315 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407319 2550 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407322 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407326 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:54:46.411275 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407329 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407333 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407336 2550 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407339 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407342 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407346 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407349 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407353 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407356 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407359 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407362 2550 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407365 2550 flags.go:64] FLAG: --enable-server="true" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407368 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407372 2550 flags.go:64] FLAG: --event-burst="100" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407375 2550 flags.go:64] FLAG: --event-qps="50" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407378 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407381 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407384 2550 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407389 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407392 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407395 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407398 2550 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407401 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407403 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407407 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:54:46.411894 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407410 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407413 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407416 2550 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407419 2550 flags.go:64] FLAG: --feature-gates="" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407423 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407425 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407428 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407432 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407435 2550 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407438 2550 flags.go:64] FLAG: --help="false" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407441 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407444 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407447 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407450 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407453 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407456 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407459 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407462 2550 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407465 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407468 2550 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407471 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407474 2550 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407476 2550 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407479 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:54:46.412557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407482 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407485 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407488 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407491 2550 flags.go:64] FLAG: --lock-file="" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407494 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407497 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407500 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407506 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407509 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407512 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407515 2550 flags.go:64] FLAG: --logging-format="text" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407518 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407533 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407536 2550 flags.go:64] FLAG: --manifest-url="" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407540 2550 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407545 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407548 2550 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407552 2550 flags.go:64] FLAG: --max-pods="110" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407555 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407558 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407561 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407564 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407567 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407570 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407573 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:54:46.413211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407580 2550 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407583 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407586 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407589 2550 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407592 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407597 2550 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407600 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407603 2550 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407606 2550 flags.go:64] FLAG: --port="10250" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407609 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407612 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-025df42a2a81f8aa1" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407615 2550 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407618 2550 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407621 2550 flags.go:64] FLAG: --register-node="true" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407624 2550 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407628 2550 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407631 2550 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407634 2550 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407637 2550 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407641 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407644 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407647 2550 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407650 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407652 2550 flags.go:64] FLAG: --runonce="false" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407655 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:54:46.413832 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407658 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407661 2550 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407664 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407667 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407669 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407672 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407675 2550 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407678 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407681 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407684 2550 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407687 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407707 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407710 2550 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407713 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407718 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407721 2550 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407724 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407729 2550 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407732 2550 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407734 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407737 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407740 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407743 2550 flags.go:64] FLAG: --v="2" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407747 2550 flags.go:64] FLAG: --version="false" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407757 2550 flags.go:64] FLAG: --vmodule="" Jun 09 11:54:46.414455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407761 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.407764 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407878 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407882 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407885 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407888 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407891 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407893 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407896 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407899 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407901 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407904 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407907 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407910 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407913 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407915 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407918 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407920 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407923 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407926 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.415113 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407928 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407931 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407937 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407940 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407942 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407945 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407948 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407951 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407954 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407956 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407959 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407962 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407965 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407967 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407970 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407972 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407975 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407977 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407980 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407982 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.415628 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407985 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407988 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407990 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407993 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407995 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.407998 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408001 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408003 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408006 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408008 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408011 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408015 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408018 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408020 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408024 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408027 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408030 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408033 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408035 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408038 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.416124 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408041 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408043 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408046 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408049 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408051 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408055 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408058 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408060 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408063 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408066 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408069 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408071 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408074 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408076 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408079 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408081 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408084 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408086 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408089 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408091 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.416624 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408094 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408096 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408100 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408105 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408108 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408111 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408115 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408117 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408120 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408124 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408127 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408131 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408134 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408136 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408140 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408144 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408147 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408149 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408153 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.417190 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408156 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.408159 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.408937 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416014 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416030 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416049 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416055 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416114 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416118 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416121 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416125 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416128 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416131 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416134 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416137 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.417658 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416141 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416144 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416147 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416150 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416153 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416156 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416159 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416162 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416164 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416167 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416170 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416172 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416175 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416179 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416183 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416186 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416188 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416191 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416194 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416197 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.418047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416200 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416209 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416212 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416215 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416217 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416220 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416223 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416225 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416228 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416231 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416233 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416236 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416238 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416241 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416243 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416246 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416249 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416252 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416254 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416257 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.418530 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416259 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416262 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416265 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416267 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416270 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416273 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416275 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416278 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416280 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416283 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416285 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416288 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416290 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416295 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416305 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416308 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416311 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416314 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416316 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.419052 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416319 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416322 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416325 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416327 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416330 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416332 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416335 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416338 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416340 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416348 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416351 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416354 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416356 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416360 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416363 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416366 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416369 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416372 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416375 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.419550 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416378 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416380 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416383 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416386 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416389 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416393 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416395 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416398 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416401 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416404 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416407 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416410 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416413 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416418 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416534 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:46.420047 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416538 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416541 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416544 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416547 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416550 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416552 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416555 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416557 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416560 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416563 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416565 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416568 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416570 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416573 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416576 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416578 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416581 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416583 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416586 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416588 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:46.420422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416591 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416593 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416596 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416599 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416602 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416605 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416608 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416611 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416613 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416616 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416618 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416621 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416625 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416629 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416632 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416635 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416638 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416640 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416643 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416646 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:46.420908 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416648 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416651 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416653 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416656 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416659 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416662 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416664 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416667 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416669 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416672 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416674 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416677 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416679 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416682 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416685 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416704 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416710 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416713 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416716 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:46.421507 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416719 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416727 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416734 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416737 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416744 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416747 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416750 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416752 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416755 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416758 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416761 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416764 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416767 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416769 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416772 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416775 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416778 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416780 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416783 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416786 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:46.421999 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416789 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416792 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416794 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416797 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416800 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416802 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416805 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416807 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416811 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416814 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416816 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416819 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416821 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416824 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416827 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416829 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416832 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416835 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:46.422726 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:46.416837 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416843 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.416939 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.419361 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.420969 2550 server.go:1019] "Starting client certificate rotation" Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.421087 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:54:46.423338 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.421154 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:54:46.424674 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.424657 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:54:46.427890 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.427873 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:54:46.440600 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.440582 2550 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:54:46.444032 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.444007 2550 log.go:25] "Validated CRI v1 image API" Jun 09 11:54:46.445454 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.445427 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:54:46.449320 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.449299 2550 fs.go:135] Filesystem UUIDs: map[176b75d0-4f40-45e6-9c0f-bba98a8787b9:/dev/nvme0n1p3 70ed0c1d-36c8-4f66-8e7f-8f46c3afef1d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 09 11:54:46.449406 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.449318 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:54:46.452825 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.452807 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:54:46.455553 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.455431 2550 manager.go:216] Machine: {Timestamp:2026-06-09 11:54:46.45400493 +0000 UTC m=+0.373887427 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100185 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23fd362e45d5ce3d176cc875525059 SystemUUID:ec23fd36-2e45-d5ce-3d17-6cc875525059 BootID:aebb1247-f345-4b5f-be68-cceed46fb0f2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:10:fd:c3:20:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:10:fd:c3:20:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:07:8f:5e:b3:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:54:46.455553 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.455549 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:54:46.455666 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.455630 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:54:46.459519 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.459487 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:54:46.459682 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.459529 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:54:46.460492 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.460480 2550 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:54:46.460558 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.460500 2550 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:54:46.460558 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.460512 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:54:46.461312 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.461300 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:54:46.462505 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.462493 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:54:46.466875 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.466861 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:54:46.467016 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467005 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:54:46.467075 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467042 2550 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:54:46.467075 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467057 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:54:46.467075 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467072 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:54:46.467197 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467085 2550 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:54:46.467197 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467097 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:54:46.467477 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467463 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:54:46.467548 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.467485 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:54:46.470565 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.470550 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:54:46.472182 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.472168 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:54:46.472229 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.472198 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:54:46.473646 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473634 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473651 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473658 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473664 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473673 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473679 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473701 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473710 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473717 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473722 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:54:46.473727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473731 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:54:46.473994 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.473738 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:54:46.474569 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.474560 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:54:46.474569 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.474569 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:54:46.478083 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.478069 2550 server.go:1268] "Started kubelet" Jun 09 11:54:46.478259 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.478197 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:54:46.478259 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.478211 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:54:46.478398 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.478280 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:54:46.478876 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.478838 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:54:46.478876 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.478859 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:54:46.479051 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.478945 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:54:46.479112 ip-10-0-129-85 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:54:46.480081 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.480070 2550 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:54:46.480354 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.480335 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:54:46.485057 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.483879 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-85.ec2.internal.18b76799775515f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-85.ec2.internal,UID:ip-10-0-129-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-85.ec2.internal,},FirstTimestamp:2026-06-09 11:54:46.478042609 +0000 UTC m=+0.397925106,LastTimestamp:2026-06-09 11:54:46.478042609 +0000 UTC m=+0.397925106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-85.ec2.internal,}" Jun 09 11:54:46.485303 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.485285 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:54:46.487451 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.487429 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:54:46.487547 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.487433 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:54:46.487600 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.487552 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.488288 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488273 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:54:46.488393 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488289 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:54:46.488464 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488429 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:54:46.488464 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488356 2550 factory.go:55] Registering systemd factory Jun 09 11:54:46.488560 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488466 2550 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:54:46.488758 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488578 2550 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:54:46.488831 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488761 2550 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:54:46.488831 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488705 2550 factory.go:153] Registering CRI-O factory Jun 09 11:54:46.488831 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488786 2550 factory.go:223] Registration of the crio container factory successfully Jun 09 11:54:46.488957 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488869 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:54:46.488957 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488890 2550 factory.go:103] Registering Raw factory Jun 09 11:54:46.488957 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.488900 2550 manager.go:1196] Started watching for new ooms in manager Jun 09 11:54:46.489206 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.489196 2550 manager.go:349] Starting recovery of all containers Jun 09 11:54:46.498189 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.498158 2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 11:54:46.498294 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.498224 2550 manager.go:354] Recovery completed Jun 09 11:54:46.498407 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.498381 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 11:54:46.502265 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.502253 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.504442 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.504418 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jx5k4" Jun 09 11:54:46.505704 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.505677 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.505769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.505716 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.505769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.505730 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.506263 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.506249 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:54:46.506263 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.506261 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:54:46.506384 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.506276 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:54:46.506384 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.506303 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.507286 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.507267 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.507360 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.507301 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.507360 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.507315 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.508622 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.508608 2550 policy_none.go:49] "None policy: Start" Jun 09 11:54:46.508622 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.508624 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:54:46.508718 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.508635 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:54:46.510292 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.510281 2550 policy_none.go:47] "Start" Jun 09 11:54:46.512790 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.512766 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jx5k4" Jun 09 11:54:46.516552 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.516491 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-85.ec2.internal.18b7679978fb2757 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-85.ec2.internal,UID:ip-10-0-129-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-85.ec2.internal,},FirstTimestamp:2026-06-09 11:54:46.505703255 +0000 UTC m=+0.425585752,LastTimestamp:2026-06-09 11:54:46.505703255 +0000 UTC m=+0.425585752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-85.ec2.internal,}" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552221 2550 manager.go:337] "Starting Device Plugin manager" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.552248 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552258 2550 server.go:87] "Starting device plugin registration server" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552498 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552512 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552607 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552737 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.552747 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.553313 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.553362 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.554466 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.555614 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.555648 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.555666 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.555709 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:54:46.565777 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.557961 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:46.653232 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.653150 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.654139 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.654122 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.654237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.654150 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.654237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.654160 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.654237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.654182 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.656268 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.656246 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal"] Jun 09 11:54:46.656325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.656306 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.657883 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.657867 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.657969 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.657891 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.657969 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.657900 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.660441 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.660429 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.660564 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.660549 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.660600 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.660577 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.661436 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661419 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.661506 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661449 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.661506 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661458 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.661506 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661464 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.661506 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661476 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.661506 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.661489 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.663761 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.663742 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.663844 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.663781 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:46.664028 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.664008 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.664105 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.664028 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-85.ec2.internal\": node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.664467 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.664453 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:46.664556 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.664474 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:46.664556 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.664484 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:46.683242 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.683224 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-85.ec2.internal\" not found" node="ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.686657 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.686642 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-85.ec2.internal\" not found" node="ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.689665 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.689649 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbfeb1994c2bac4a8dfa92f1e1823c15-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"bbfeb1994c2bac4a8dfa92f1e1823c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.689754 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.689675 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.689754 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.689706 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.694118 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.694101 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.790788 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790760 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.790916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790793 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.790916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790814 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbfeb1994c2bac4a8dfa92f1e1823c15-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"bbfeb1994c2bac4a8dfa92f1e1823c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.790916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790869 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.790916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790895 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c9a9f2b5539e7a75832f63deb43d54cb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal\" (UID: \"c9a9f2b5539e7a75832f63deb43d54cb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.790916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.790869 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbfeb1994c2bac4a8dfa92f1e1823c15-config\") pod \"kube-apiserver-proxy-ip-10-0-129-85.ec2.internal\" (UID: \"bbfeb1994c2bac4a8dfa92f1e1823c15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.794879 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.794860 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.895495 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.895468 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:46.990107 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.990038 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.993486 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:46.993468 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:46.995728 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:46.995715 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.096631 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.096593 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.197192 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.197169 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.297790 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.297717 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.345588 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.345564 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:47.398133 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.398103 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.420278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.420249 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:54:47.420395 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.420373 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:54:47.420436 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.420403 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:54:47.498334 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.498302 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.516278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.516244 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:49:46 +0000 UTC" deadline="2027-11-12 15:45:27.462652575 +0000 UTC" Jun 09 11:54:47.516278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.516273 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12507h50m39.946382593s" Jun 09 11:54:47.595749 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:47.595707 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbfeb1994c2bac4a8dfa92f1e1823c15.slice/crio-0bb5caee4f3a6ed667bddfd9637fa9f9df651daf4ebc3b5ff6b457ea36718654 WatchSource:0}: Error finding container 0bb5caee4f3a6ed667bddfd9637fa9f9df651daf4ebc3b5ff6b457ea36718654: Status 404 returned error can't find the container with id 0bb5caee4f3a6ed667bddfd9637fa9f9df651daf4ebc3b5ff6b457ea36718654 Jun 09 11:54:47.596753 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:47.596731 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a9f2b5539e7a75832f63deb43d54cb.slice/crio-b565370593b329cc71a276bfe26ae97cf14597490e1c7f489d221493622ab1ea WatchSource:0}: Error finding container b565370593b329cc71a276bfe26ae97cf14597490e1c7f489d221493622ab1ea: Status 404 returned error can't find the container with id b565370593b329cc71a276bfe26ae97cf14597490e1c7f489d221493622ab1ea Jun 09 11:54:47.598875 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:47.598857 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-85.ec2.internal\" not found" Jun 09 11:54:47.601773 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.601757 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:54:47.606501 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.606484 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:47.607169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.607151 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:47.607246 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.607178 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:47.607246 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.607190 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:47.673398 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.673371 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:47.682031 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.682003 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:47.688054 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.688034 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" Jun 09 11:54:47.701600 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.701580 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:54:47.702700 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.702678 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" Jun 09 11:54:47.711269 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:47.711254 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:54:48.467847 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.467818 2550 apiserver.go:52] "Watching apiserver" Jun 09 11:54:48.477296 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.477266 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:54:48.477757 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.477723 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-m9hsf","openshift-network-operator/iptables-alerter-fw5xn","kube-system/konnectivity-agent-ctjk7","kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6rnk4","openshift-dns/node-resolver-zcn4t","openshift-image-registry/node-ca-tgqkx","openshift-multus/multus-additional-cni-plugins-qfdts","openshift-multus/network-metrics-daemon-zxl4m","openshift-ovn-kubernetes/ovnkube-node-ksqmz","kube-system/global-pull-secret-syncer-25wt8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal","openshift-multus/multus-8hhcl"] Jun 09 11:54:48.480448 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.480423 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.482884 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.482615 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.482884 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.482685 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:54:48.483426 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.483183 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:54:48.483426 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.483211 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:54:48.483426 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.483244 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2l5q6\"" Jun 09 11:54:48.483426 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.483311 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.484291 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.484144 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:54:48.484291 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.484214 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:54:48.484291 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.484288 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.484877 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.484860 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.487044 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.487019 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.488662 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.488177 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:54:48.488662 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.488287 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:54:48.489667 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.488985 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-57cjh\"" Jun 09 11:54:48.489667 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.489148 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:54:48.490595 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.490573 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:54:48.490682 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.490618 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:54:48.490682 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.490648 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.491021 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.490996 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vtpcs\"" Jun 09 11:54:48.491111 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.491032 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.491182 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.491122 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.493448 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.493359 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.495307 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.494916 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.495307 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.495003 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.495307 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.495092 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znkrk\"" Jun 09 11:54:48.496041 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.495733 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.496041 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.495798 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:48.497014 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.496835 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xv5hs\"" Jun 09 11:54:48.497014 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.496882 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.497014 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.496838 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497480 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-system-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497512 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-log-socket\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497537 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-netd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497561 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497586 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-systemd\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-netns\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.497659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497631 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-agent-certs\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497748 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-kubernetes\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497781 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-netns\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497806 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-var-lib-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497830 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-multus\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497856 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-etc-tuned\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497880 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497908 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-script-lib\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497931 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6ppv\" (UniqueName: \"kubernetes.io/projected/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-kube-api-access-b6ppv\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497953 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-etc-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.497988 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-node-log\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498023 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-kubelet\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498079 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498071 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-socket-dir-parent\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498101 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-hostroot\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498128 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-conf-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498152 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-daemon-config\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498176 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-modprobe-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498209 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-lib-modules\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498238 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498260 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498288 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-conf\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498311 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-host\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498334 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-tmp\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498381 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-kubelet\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498413 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlp9\" (UniqueName: \"kubernetes.io/projected/c7e47718-ea2b-4777-bdb1-a574db2506f3-kube-api-access-zwlp9\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498438 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-os-release\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498478 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-bin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498513 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-multus-certs\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498538 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.498731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498586 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-bin\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovn-node-metrics-cert\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498630 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-env-overrides\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498744 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498788 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-sys\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498832 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27pz8\" (UniqueName: \"kubernetes.io/projected/f36d1753-2425-4714-9b60-fba80412d3a6-kube-api-access-27pz8\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498854 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-systemd-units\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-slash\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.498920 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499088 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-k8s-cni-cncf-io\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-etc-kubernetes\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499137 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-systemd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499174 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-dbus\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499199 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cnibin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499220 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cni-binary-copy\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499240 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysconfig\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499273 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-var-lib-kubelet\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.499829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499394 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-kubelet-config\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.500347 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499420 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-ovn\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.500347 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499455 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-konnectivity-ca\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.500347 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499501 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-run\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.500347 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.499608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-config\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.501315 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.501296 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:54:48.501315 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.501311 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.503680 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.503595 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:54:48.503839 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.503680 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:54:48.503900 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.503833 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kk728\"" Jun 09 11:54:48.505100 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.504671 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:54:48.505100 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.504772 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.505100 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.504871 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:48.505309 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.505047 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:48.505309 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.505256 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6g6ss\"" Jun 09 11:54:48.505309 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.505282 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.508343 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.508312 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.510773 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.510754 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.510773 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.510770 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.510999 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.510983 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-82dt6\"" Jun 09 11:54:48.511255 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.511234 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.511365 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.511349 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:54:48.513309 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.513221 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:54:48.513309 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.513248 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:54:48.513470 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.513454 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:54:48.513678 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.513583 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6mbxp\"" Jun 09 11:54:48.523129 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.523110 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6lkh9" Jun 09 11:54:48.531362 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.531340 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6lkh9" Jun 09 11:54:48.559864 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.559820 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" event={"ID":"bbfeb1994c2bac4a8dfa92f1e1823c15","Type":"ContainerStarted","Data":"0bb5caee4f3a6ed667bddfd9637fa9f9df651daf4ebc3b5ff6b457ea36718654"} Jun 09 11:54:48.560877 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.560852 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"c9a9f2b5539e7a75832f63deb43d54cb","Type":"ContainerStarted","Data":"b565370593b329cc71a276bfe26ae97cf14597490e1c7f489d221493622ab1ea"} Jun 09 11:54:48.589764 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.589741 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:54:48.599866 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-kubelet\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.599866 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-socket-dir-parent\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599890 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-hostroot\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599913 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-conf-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599916 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-kubelet\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599935 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-daemon-config\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599953 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-hostroot\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599967 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-modprobe-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599918 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-socket-dir-parent\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.599995 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-lib-modules\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600003 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-conf-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600018 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.600056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600080 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-modprobe-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600085 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-conf\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600102 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600112 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-lib-modules\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600124 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-host\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-tmp\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600161 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-host\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600167 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-kubelet\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600190 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlp9\" (UniqueName: \"kubernetes.io/projected/c7e47718-ea2b-4777-bdb1-a574db2506f3-kube-api-access-zwlp9\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600203 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-conf\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600205 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysctl-d\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600217 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rb7v\" (UniqueName: \"kubernetes.io/projected/cb53e4e4-5938-46cd-bd99-90c67febaed3-kube-api-access-7rb7v\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600243 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85d3c102-2722-4e5b-9b54-0f026e49958d-iptables-alerter-script\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600252 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-kubelet\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600270 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-os-release\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600300 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-bin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.600427 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600323 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-multus-certs\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600346 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600368 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-bin\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600392 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovn-node-metrics-cert\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600397 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-multus-certs\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600392 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-bin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600437 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600436 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-bin\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600478 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600480 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-os-release\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600504 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-registration-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600534 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-daemon-config\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600553 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-env-overrides\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600593 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-sys\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600653 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27pz8\" (UniqueName: \"kubernetes.io/projected/f36d1753-2425-4714-9b60-fba80412d3a6-kube-api-access-27pz8\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600682 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-systemd-units\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600656 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-sys\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.601198 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600723 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-slash\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600749 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-systemd-units\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600750 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lkzr\" (UniqueName: \"kubernetes.io/projected/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-kube-api-access-4lkzr\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600784 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600830 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-slash\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.600900 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-multus-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601020 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-env-overrides\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601293 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-k8s-cni-cncf-io\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601319 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-etc-kubernetes\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601340 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-systemd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601361 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-dbus\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601386 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-sys-fs\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601402 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-k8s-cni-cncf-io\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601426 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-systemd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601413 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-cnibin\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601433 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-etc-kubernetes\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601468 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601498 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cnibin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.602088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601519 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-dbus\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601520 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cni-binary-copy\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601559 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysconfig\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601566 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cnibin\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601584 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-var-lib-kubelet\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601609 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-sysconfig\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601609 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-kubelet-config\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601656 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a7903e8-8f8b-4b73-99b2-441ffce940a2-kubelet-config\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601659 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601671 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-var-lib-kubelet\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601706 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-ovn\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601739 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-run-ovn\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601763 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-konnectivity-ca\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601831 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601858 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slknw\" (UniqueName: \"kubernetes.io/projected/1da65db6-d300-45d8-98eb-f7e7a91a9490-kube-api-access-slknw\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601892 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-run\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601913 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-config\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601933 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601950 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601970 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-run\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.601963 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-host\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602014 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-serviceca\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602025 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-cni-binary-copy\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602045 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-hosts-file\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602086 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-system-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602114 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-log-socket\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602135 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-netd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602140 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-system-cni-dir\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602170 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-log-socket\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602176 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602189 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-cni-netd\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602224 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xcw8\" (UniqueName: \"kubernetes.io/projected/4409654c-db4b-4eb9-b319-d4c7112eaf48-kube-api-access-7xcw8\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602260 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-tmp-dir\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.602277 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602287 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-systemd\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.603905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602312 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602317 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-konnectivity-ca\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.602363 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:49.102320991 +0000 UTC m=+3.022203483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602374 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-systemd\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602415 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-netns\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602472 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-agent-certs\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602510 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-run-netns\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602514 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b6l9\" (UniqueName: \"kubernetes.io/projected/85d3c102-2722-4e5b-9b54-0f026e49958d-kube-api-access-2b6l9\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602560 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-socket-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602575 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-device-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602584 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-config\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602591 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-os-release\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602613 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-kubernetes\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602657 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-netns\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602683 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f36d1753-2425-4714-9b60-fba80412d3a6-etc-kubernetes\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602741 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-run-netns\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.604815 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602768 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-var-lib-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602797 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d3c102-2722-4e5b-9b54-0f026e49958d-host-slash\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602817 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602839 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-var-lib-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-multus\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602922 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-host-var-lib-cni-multus\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.602898 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-etc-tuned\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603314 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603385 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-script-lib\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603422 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfhzq\" (UniqueName: \"kubernetes.io/projected/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-kube-api-access-xfhzq\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603455 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6ppv\" (UniqueName: \"kubernetes.io/projected/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-kube-api-access-b6ppv\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603489 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-etc-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603520 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-node-log\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603554 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.605614 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.603711 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.605174 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b0cd852-2af8-4e7b-9fc6-557eb6a7f801-agent-certs\") pod \"konnectivity-agent-ctjk7\" (UID: \"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801\") " pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.605331 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-tmp\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.605671 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-etc-openvswitch\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.605742 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7e47718-ea2b-4777-bdb1-a574db2506f3-node-log\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.605948 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovn-node-metrics-cert\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.606886 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.606076 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7e47718-ea2b-4777-bdb1-a574db2506f3-ovnkube-script-lib\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.607241 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.607065 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f36d1753-2425-4714-9b60-fba80412d3a6-etc-tuned\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.608562 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.608413 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlp9\" (UniqueName: \"kubernetes.io/projected/c7e47718-ea2b-4777-bdb1-a574db2506f3-kube-api-access-zwlp9\") pod \"ovnkube-node-ksqmz\" (UID: \"c7e47718-ea2b-4777-bdb1-a574db2506f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.610371 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.610323 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27pz8\" (UniqueName: \"kubernetes.io/projected/f36d1753-2425-4714-9b60-fba80412d3a6-kube-api-access-27pz8\") pod \"tuned-6rnk4\" (UID: \"f36d1753-2425-4714-9b60-fba80412d3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.612337 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.612319 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6ppv\" (UniqueName: \"kubernetes.io/projected/8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a-kube-api-access-b6ppv\") pod \"multus-8hhcl\" (UID: \"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a\") " pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.704394 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704355 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rb7v\" (UniqueName: \"kubernetes.io/projected/cb53e4e4-5938-46cd-bd99-90c67febaed3-kube-api-access-7rb7v\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.704575 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704484 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85d3c102-2722-4e5b-9b54-0f026e49958d-iptables-alerter-script\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.704575 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704508 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:48.704575 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704532 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-registration-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704575 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lkzr\" (UniqueName: \"kubernetes.io/projected/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-kube-api-access-4lkzr\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704589 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-sys-fs\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704611 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-cnibin\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704633 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704664 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704665 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-registration-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704706 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704735 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slknw\" (UniqueName: \"kubernetes.io/projected/1da65db6-d300-45d8-98eb-f7e7a91a9490-kube-api-access-slknw\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704752 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-cnibin\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704760 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704798 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704813 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704826 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-host\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704850 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-serviceca\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.704885 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704870 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704912 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-host\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705012 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704873 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-hosts-file\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705077 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xcw8\" (UniqueName: \"kubernetes.io/projected/4409654c-db4b-4eb9-b319-d4c7112eaf48-kube-api-access-7xcw8\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705104 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-tmp-dir\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705128 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705154 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b6l9\" (UniqueName: \"kubernetes.io/projected/85d3c102-2722-4e5b-9b54-0f026e49958d-kube-api-access-2b6l9\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705178 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-socket-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705204 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-device-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705206 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85d3c102-2722-4e5b-9b54-0f026e49958d-iptables-alerter-script\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705230 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-os-release\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705257 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d3c102-2722-4e5b-9b54-0f026e49958d-host-slash\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705277 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-hosts-file\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705279 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705321 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-serviceca\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705328 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfhzq\" (UniqueName: \"kubernetes.io/projected/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-kube-api-access-xfhzq\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.705542 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705329 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-binary-copy\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.704850 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-sys-fs\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705364 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705449 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.705537 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.705579 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:49.205566858 +0000 UTC m=+3.125449363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705579 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-device-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705581 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-tmp-dir\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705683 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-system-cni-dir\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705687 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4409654c-db4b-4eb9-b319-d4c7112eaf48-socket-dir\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705770 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d3c102-2722-4e5b-9b54-0f026e49958d-host-slash\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705775 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1da65db6-d300-45d8-98eb-f7e7a91a9490-os-release\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.706240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.705845 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1da65db6-d300-45d8-98eb-f7e7a91a9490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.715408 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.715386 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:48.715408 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.715407 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:48.715408 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.715416 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:48.715622 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:48.715472 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:49.215459421 +0000 UTC m=+3.135341904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:48.719870 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.719810 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lkzr\" (UniqueName: \"kubernetes.io/projected/f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c-kube-api-access-4lkzr\") pod \"node-ca-tgqkx\" (UID: \"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c\") " pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.720050 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.720018 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b6l9\" (UniqueName: \"kubernetes.io/projected/85d3c102-2722-4e5b-9b54-0f026e49958d-kube-api-access-2b6l9\") pod \"iptables-alerter-fw5xn\" (UID: \"85d3c102-2722-4e5b-9b54-0f026e49958d\") " pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.720332 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.720303 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfhzq\" (UniqueName: \"kubernetes.io/projected/4c3b6ba0-5cac-4173-89ff-0eb8a293430a-kube-api-access-xfhzq\") pod \"node-resolver-zcn4t\" (UID: \"4c3b6ba0-5cac-4173-89ff-0eb8a293430a\") " pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.720795 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.720772 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slknw\" (UniqueName: \"kubernetes.io/projected/1da65db6-d300-45d8-98eb-f7e7a91a9490-kube-api-access-slknw\") pod \"multus-additional-cni-plugins-qfdts\" (UID: \"1da65db6-d300-45d8-98eb-f7e7a91a9490\") " pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.720871 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.720818 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rb7v\" (UniqueName: \"kubernetes.io/projected/cb53e4e4-5938-46cd-bd99-90c67febaed3-kube-api-access-7rb7v\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:48.721263 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.721240 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xcw8\" (UniqueName: \"kubernetes.io/projected/4409654c-db4b-4eb9-b319-d4c7112eaf48-kube-api-access-7xcw8\") pod \"aws-ebs-csi-driver-node-xrmfd\" (UID: \"4409654c-db4b-4eb9-b319-d4c7112eaf48\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:48.783707 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.783654 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:48.794116 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.794087 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:54:48.803600 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.803405 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:54:48.816106 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.816080 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hhcl" Jun 09 11:54:48.821784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.821759 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" Jun 09 11:54:48.829326 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.829306 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zcn4t" Jun 09 11:54:48.836929 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.836910 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qfdts" Jun 09 11:54:48.845570 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.845545 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fw5xn" Jun 09 11:54:48.853263 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.853241 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgqkx" Jun 09 11:54:48.858955 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:48.858934 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" Jun 09 11:54:49.107909 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:49.107797 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:49.108057 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.107972 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:49.108057 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.108050 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:50.108030989 +0000 UTC m=+4.027913472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:49.209033 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:49.209000 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:49.209172 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.209117 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:49.209172 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.209170 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:50.209155383 +0000 UTC m=+4.129037867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:49.310102 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:49.310065 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:49.310252 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.310231 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:49.310311 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.310258 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:49.310311 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.310268 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:49.310382 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:49.310319 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:50.310305387 +0000 UTC m=+4.230187871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:49.535429 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:49.535396 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:49:48 +0000 UTC" deadline="2027-12-29 00:47:23.512004417 +0000 UTC" Jun 09 11:54:49.535429 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:49.535423 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13620h52m33.976585454s" Jun 09 11:54:49.570841 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.570803 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4409654c_db4b_4eb9_b319_d4c7112eaf48.slice/crio-65510705361abe0fa41c721135a927a5e25d6eab9fe00d1cca4ef344f630617b WatchSource:0}: Error finding container 65510705361abe0fa41c721135a927a5e25d6eab9fe00d1cca4ef344f630617b: Status 404 returned error can't find the container with id 65510705361abe0fa41c721135a927a5e25d6eab9fe00d1cca4ef344f630617b Jun 09 11:54:49.571798 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.571775 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da65db6_d300_45d8_98eb_f7e7a91a9490.slice/crio-cd4ec4e2177f7dbe242f7fcd0b251de0915afb6e01ad7cd2786dcf44f0c14182 WatchSource:0}: Error finding container cd4ec4e2177f7dbe242f7fcd0b251de0915afb6e01ad7cd2786dcf44f0c14182: Status 404 returned error can't find the container with id cd4ec4e2177f7dbe242f7fcd0b251de0915afb6e01ad7cd2786dcf44f0c14182 Jun 09 11:54:49.572780 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.572746 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3b6ba0_5cac_4173_89ff_0eb8a293430a.slice/crio-799c0548e3cd93c3f74d3d1390a7c4cfcfa7ab3e8f7c616d4b4c673556bf3c43 WatchSource:0}: Error finding container 799c0548e3cd93c3f74d3d1390a7c4cfcfa7ab3e8f7c616d4b4c673556bf3c43: Status 404 returned error can't find the container with id 799c0548e3cd93c3f74d3d1390a7c4cfcfa7ab3e8f7c616d4b4c673556bf3c43 Jun 09 11:54:49.574579 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.574556 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36d1753_2425_4714_9b60_fba80412d3a6.slice/crio-0670d4771dae7fa3e449ea59e35cbe05f6be548141691b9e57450c6f7a76cc2b WatchSource:0}: Error finding container 0670d4771dae7fa3e449ea59e35cbe05f6be548141691b9e57450c6f7a76cc2b: Status 404 returned error can't find the container with id 0670d4771dae7fa3e449ea59e35cbe05f6be548141691b9e57450c6f7a76cc2b Jun 09 11:54:49.576950 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.576864 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2dc76ff_a49e_4b15_a1e3_9a56bce4b59c.slice/crio-5941d5b5275250318e9bcb20d9007f3c090d232dccb8051d295ff251f5a38617 WatchSource:0}: Error finding container 5941d5b5275250318e9bcb20d9007f3c090d232dccb8051d295ff251f5a38617: Status 404 returned error can't find the container with id 5941d5b5275250318e9bcb20d9007f3c090d232dccb8051d295ff251f5a38617 Jun 09 11:54:49.579165 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.579144 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0cd852_2af8_4e7b_9fc6_557eb6a7f801.slice/crio-356d8b22092f1dc3ff53c45bb5af242c72c3c3c502e32759351c3717377c47cd WatchSource:0}: Error finding container 356d8b22092f1dc3ff53c45bb5af242c72c3c3c502e32759351c3717377c47cd: Status 404 returned error can't find the container with id 356d8b22092f1dc3ff53c45bb5af242c72c3c3c502e32759351c3717377c47cd Jun 09 11:54:49.580983 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.580966 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0ea3a4_dc2e_42b2_b83c_6a9a4a78bc2a.slice/crio-e1ffb0e8a81585cbdcf7bbe498bca68db1c886ca2694d8502bf79274687a2c85 WatchSource:0}: Error finding container e1ffb0e8a81585cbdcf7bbe498bca68db1c886ca2694d8502bf79274687a2c85: Status 404 returned error can't find the container with id e1ffb0e8a81585cbdcf7bbe498bca68db1c886ca2694d8502bf79274687a2c85 Jun 09 11:54:49.582537 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.582518 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e47718_ea2b_4777_bdb1_a574db2506f3.slice/crio-d7693d5937e7100abd9f1a85d9615732ef915b491469f4374e3253dc89329303 WatchSource:0}: Error finding container d7693d5937e7100abd9f1a85d9615732ef915b491469f4374e3253dc89329303: Status 404 returned error can't find the container with id d7693d5937e7100abd9f1a85d9615732ef915b491469f4374e3253dc89329303 Jun 09 11:54:49.604366 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:54:49.604343 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d3c102_2722_4e5b_9b54_0f026e49958d.slice/crio-c3c86f65fd5233cf9841884803d64932fc2b9f7e5c15a93e445569c7270962e2 WatchSource:0}: Error finding container c3c86f65fd5233cf9841884803d64932fc2b9f7e5c15a93e445569c7270962e2: Status 404 returned error can't find the container with id c3c86f65fd5233cf9841884803d64932fc2b9f7e5c15a93e445569c7270962e2 Jun 09 11:54:50.115813 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.115147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:50.115813 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.115327 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:50.115813 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.115389 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:52.115370242 +0000 UTC m=+6.035252729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:50.169994 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.169964 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:50.216007 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.215977 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:50.216163 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.216051 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:52.216032719 +0000 UTC m=+6.135915219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:50.216249 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.215853 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:50.317264 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.317222 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:50.317462 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.317428 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:50.317462 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.317450 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:50.317462 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.317463 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:50.317636 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.317522 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:52.317504117 +0000 UTC m=+6.237386617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:50.536300 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.536236 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:49:48 +0000 UTC" deadline="2027-12-29 22:14:21.379446556 +0000 UTC" Jun 09 11:54:50.536300 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.536298 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13642h19m30.843152839s" Jun 09 11:54:50.559154 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.559125 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:50.559302 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.559253 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:54:50.559686 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.559665 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:50.559816 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.559796 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:50.559873 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.559862 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:50.559970 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:50.559927 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:50.583594 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.583554 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fw5xn" event={"ID":"85d3c102-2722-4e5b-9b54-0f026e49958d","Type":"ContainerStarted","Data":"c3c86f65fd5233cf9841884803d64932fc2b9f7e5c15a93e445569c7270962e2"} Jun 09 11:54:50.589025 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.586570 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgqkx" event={"ID":"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c","Type":"ContainerStarted","Data":"5941d5b5275250318e9bcb20d9007f3c090d232dccb8051d295ff251f5a38617"} Jun 09 11:54:50.589025 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.588177 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" event={"ID":"f36d1753-2425-4714-9b60-fba80412d3a6","Type":"ContainerStarted","Data":"0670d4771dae7fa3e449ea59e35cbe05f6be548141691b9e57450c6f7a76cc2b"} Jun 09 11:54:50.591736 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.591423 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcn4t" event={"ID":"4c3b6ba0-5cac-4173-89ff-0eb8a293430a","Type":"ContainerStarted","Data":"799c0548e3cd93c3f74d3d1390a7c4cfcfa7ab3e8f7c616d4b4c673556bf3c43"} Jun 09 11:54:50.605567 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.605531 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" event={"ID":"4409654c-db4b-4eb9-b319-d4c7112eaf48","Type":"ContainerStarted","Data":"65510705361abe0fa41c721135a927a5e25d6eab9fe00d1cca4ef344f630617b"} Jun 09 11:54:50.613260 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.613232 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" event={"ID":"bbfeb1994c2bac4a8dfa92f1e1823c15","Type":"ContainerStarted","Data":"b8a78a1f62b0a3e81af096a5fa623edd4276d5c3a6fabce515dc835064aeb9ff"} Jun 09 11:54:50.616796 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.616772 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"d7693d5937e7100abd9f1a85d9615732ef915b491469f4374e3253dc89329303"} Jun 09 11:54:50.624666 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.624631 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hhcl" event={"ID":"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a","Type":"ContainerStarted","Data":"e1ffb0e8a81585cbdcf7bbe498bca68db1c886ca2694d8502bf79274687a2c85"} Jun 09 11:54:50.629647 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.629545 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-85.ec2.internal" podStartSLOduration=3.629528191 podStartE2EDuration="3.629528191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:50.629317011 +0000 UTC m=+4.549199518" watchObservedRunningTime="2026-06-09 11:54:50.629528191 +0000 UTC m=+4.549410699" Jun 09 11:54:50.631474 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.631450 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctjk7" event={"ID":"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801","Type":"ContainerStarted","Data":"356d8b22092f1dc3ff53c45bb5af242c72c3c3c502e32759351c3717377c47cd"} Jun 09 11:54:50.642851 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.642819 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerStarted","Data":"cd4ec4e2177f7dbe242f7fcd0b251de0915afb6e01ad7cd2786dcf44f0c14182"} Jun 09 11:54:50.650182 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.650132 2550 generic.go:356] "Generic (PLEG): container finished" podID="c9a9f2b5539e7a75832f63deb43d54cb" containerID="008148f033a4a3ea712b5925828f0c7233ec8b108f624593b00974e3ddb405c6" exitCode=0 Jun 09 11:54:50.650182 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:50.650169 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"c9a9f2b5539e7a75832f63deb43d54cb","Type":"ContainerDied","Data":"008148f033a4a3ea712b5925828f0c7233ec8b108f624593b00974e3ddb405c6"} Jun 09 11:54:51.666379 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:51.666310 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" event={"ID":"c9a9f2b5539e7a75832f63deb43d54cb","Type":"ContainerStarted","Data":"b989f7a70875a32499ece0ea2d5425b65743d0ae99dfa27a2adc019178ccc341"} Jun 09 11:54:51.695223 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:51.695160 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-85.ec2.internal" podStartSLOduration=4.695134049 podStartE2EDuration="4.695134049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:51.692942663 +0000 UTC m=+5.612825170" watchObservedRunningTime="2026-06-09 11:54:51.695134049 +0000 UTC m=+5.615016559" Jun 09 11:54:52.132216 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.132176 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:52.132425 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.132340 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:52.132425 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.132404 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:56.132385315 +0000 UTC m=+10.052267812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:52.232753 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.232720 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:52.232945 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.232910 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:52.233008 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.232973 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:56.232954645 +0000 UTC m=+10.152837134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:52.334211 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.333476 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:52.334211 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.333726 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:52.334211 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.333746 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:52.334211 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.333759 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:52.334211 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.333819 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:56.333800425 +0000 UTC m=+10.253682915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:52.558964 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.558923 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:52.559143 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.559044 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:54:52.559143 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.559109 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:52.559263 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.559195 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:52.559263 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:52.559239 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:52.559360 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:52.559301 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:54.556307 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:54.556272 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:54.556806 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:54.556415 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:54:54.556806 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:54.556800 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:54.556942 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:54.556879 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:54.557031 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:54.557014 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:54.557110 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:54.557090 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:56.166516 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.166477 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:56.166981 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.166627 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:56.166981 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.166702 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.166670169 +0000 UTC m=+18.086552656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:56.267406 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.267347 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:56.267660 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.267641 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:56.267778 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.267722 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.267687911 +0000 UTC m=+18.187570410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:56.369094 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.368494 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:56.369094 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.368664 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:56.369094 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.368706 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:56.369094 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.368720 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:56.369094 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.368777 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.368758719 +0000 UTC m=+18.288641204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:56.556824 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.556794 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:56.557007 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.556893 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:54:56.557257 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.557239 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:56.557355 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.557336 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:56.557484 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:56.557462 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:56.557592 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:56.557533 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:58.556963 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:58.556931 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:54:58.557399 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:58.557083 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:54:58.557399 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:58.557162 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:54:58.557399 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:58.557272 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:54:58.557399 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:54:58.557333 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:54:58.557631 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:54:58.557426 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:00.556771 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:00.556732 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:00.557204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:00.556785 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:00.557204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:00.556745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:00.557204 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:00.556870 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:00.557204 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:00.556960 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:00.557204 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:00.557040 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:02.556407 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:02.556373 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:02.556407 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:02.556401 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:02.556882 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:02.556374 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:02.556882 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:02.556497 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:02.556882 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:02.556566 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:02.556882 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:02.556661 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:04.230540 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.230508 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:04.231079 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.230668 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:04.231079 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.230746 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:20.230725343 +0000 UTC m=+34.150607847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:04.330937 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.330904 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:04.331111 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.331027 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:04.331111 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.331084 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:20.33106805 +0000 UTC m=+34.250950534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:04.431391 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.431359 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:04.431574 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.431551 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:04.431629 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.431590 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:04.431629 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.431605 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:04.431718 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.431668 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:20.431650088 +0000 UTC m=+34.351532573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:04.556723 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.556633 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:04.556723 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.556667 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:04.556943 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:04.556634 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:04.556943 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.556761 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:04.556943 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.556860 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:04.557065 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:04.556945 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:06.557022 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:06.556985 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:06.557492 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:06.557071 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:06.557492 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:06.557088 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:06.557492 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:06.557173 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:06.557492 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:06.557229 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:06.557492 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:06.557306 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:08.556750 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.555908 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:08.556750 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:08.556208 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:08.556750 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.556553 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:08.556750 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:08.556668 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:08.557611 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.556949 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:08.557611 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:08.557043 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:08.700786 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.700550 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" event={"ID":"4409654c-db4b-4eb9-b319-d4c7112eaf48","Type":"ContainerStarted","Data":"616a9ea2ff168a18be76273d9f325fb5c79573bd43ff8d57e13b9855cd65ff86"} Jun 09 11:55:08.702318 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.702285 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"ebea702fd6d958f7c668e1fcb31fbdbe19ea0de25f7bb01e30dd48888e2dfab1"} Jun 09 11:55:08.702446 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.702364 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"deaed21fa5dc4cfb84c06b5cd5ab25be695c0edf6c5ca3231aa4b17d6ec4ef33"} Jun 09 11:55:08.703512 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.703487 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hhcl" event={"ID":"8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a","Type":"ContainerStarted","Data":"60db8285d78d174f7453a5b3ad76659c6ea4507c141e40543dd58a66e8933814"} Jun 09 11:55:08.705012 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.704989 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctjk7" event={"ID":"9b0cd852-2af8-4e7b-9fc6-557eb6a7f801","Type":"ContainerStarted","Data":"fee945bcd74b491ced310d5fcd6ddbeb6852b8a9fbc70a71dc3db013002106e1"} Jun 09 11:55:08.706621 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.706594 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="7ba607071d284ab66c76a63dcf8243d35b089b0a7fee4e1a0abab7ba8d387864" exitCode=0 Jun 09 11:55:08.706733 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.706715 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"7ba607071d284ab66c76a63dcf8243d35b089b0a7fee4e1a0abab7ba8d387864"} Jun 09 11:55:08.708684 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.708631 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgqkx" event={"ID":"f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c","Type":"ContainerStarted","Data":"943d96988afa457b8614e918c5de9e29320dd863fe03cb926d5f0cf7123496cf"} Jun 09 11:55:08.710799 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.710754 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" event={"ID":"f36d1753-2425-4714-9b60-fba80412d3a6","Type":"ContainerStarted","Data":"10fa76fa1859e1817686c788728f444823d5f65a52d759f8572248f11f9aafb4"} Jun 09 11:55:08.711949 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.711930 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zcn4t" event={"ID":"4c3b6ba0-5cac-4173-89ff-0eb8a293430a","Type":"ContainerStarted","Data":"ada5ecb76ba447d056f5f799d7907ecccef7b7de910a62bee8fae3ff6321932d"} Jun 09 11:55:08.724547 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.724507 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8hhcl" podStartSLOduration=3.876199571 podStartE2EDuration="22.724494797s" totalImagesPullingTime="18.848295226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:08.723952653 +0000 UTC m=+22.643835159" watchObservedRunningTime="2026-06-09 11:55:08.724494797 +0000 UTC m=+22.644377302" Jun 09 11:55:08.787902 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.787854 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ctjk7" podStartSLOduration=12.133355732 podStartE2EDuration="22.787837873s" totalImagesPullingTime="10.654482141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:08.76484562 +0000 UTC m=+22.684728331" watchObservedRunningTime="2026-06-09 11:55:08.787837873 +0000 UTC m=+22.707720442" Jun 09 11:55:08.788030 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.787949 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6rnk4" podStartSLOduration=3.954443402 podStartE2EDuration="22.787944967s" totalImagesPullingTime="18.833501565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:08.787482974 +0000 UTC m=+22.707365479" watchObservedRunningTime="2026-06-09 11:55:08.787944967 +0000 UTC m=+22.707827473" Jun 09 11:55:08.804631 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.804591 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zcn4t" podStartSLOduration=3.977658105 podStartE2EDuration="22.804576409s" totalImagesPullingTime="18.826918304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:08.80418853 +0000 UTC m=+22.724071037" watchObservedRunningTime="2026-06-09 11:55:08.804576409 +0000 UTC m=+22.724458914" Jun 09 11:55:08.836154 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:08.836119 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tgqkx" podStartSLOduration=4.008331098 podStartE2EDuration="22.836104596s" totalImagesPullingTime="18.827773498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:08.836055074 +0000 UTC m=+22.755937607" watchObservedRunningTime="2026-06-09 11:55:08.836104596 +0000 UTC m=+22.755987101" Jun 09 11:55:09.717497 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:09.717431 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"4cb84ba2508ce3731acd3eed197b480fe9b303dcf69183526f794db592703ff5"} Jun 09 11:55:09.718074 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:09.717580 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"402efc2caa4c8707cd0a257732b2785d2324bbdbfdf4eed1dabc92be38596cd3"} Jun 09 11:55:09.718074 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:09.717618 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"d80e6cc9f994799356e0c5cc86d2a769358a026539ffefafaf943b9d87b864a3"} Jun 09 11:55:09.718074 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:09.717654 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"914fdaa04457b6bc92b5052be7cc2535866cda6c3cd0a79cd3436dcf35b6b95c"} Jun 09 11:55:09.894650 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:09.894620 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:55:10.556493 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.556266 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:10.556789 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.556367 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:10.556789 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:10.556596 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:10.556789 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:10.556725 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:10.556789 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.556405 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:10.557009 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:10.556808 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:10.562848 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.562747 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:55:09.894643488Z","UUID":"26452054-e4e2-438b-a3ee-e76b5a92926a","Handler":null,"Name":"","Endpoint":""} Jun 09 11:55:10.564403 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.564382 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:55:10.564495 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.564422 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:55:10.720779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.720746 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fw5xn" event={"ID":"85d3c102-2722-4e5b-9b54-0f026e49958d","Type":"ContainerStarted","Data":"983b5038c66868249d391fc1fa04e365ab3d75888d3a26eda041f2edfb368847"} Jun 09 11:55:10.722830 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:10.722803 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" event={"ID":"4409654c-db4b-4eb9-b319-d4c7112eaf48","Type":"ContainerStarted","Data":"2cdc8222012779d1938285b74b590d03af59b6878f63d6d16153284729eabf42"} Jun 09 11:55:11.727266 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:11.727228 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" event={"ID":"4409654c-db4b-4eb9-b319-d4c7112eaf48","Type":"ContainerStarted","Data":"beb43698c26c1586e7193423cbaed989483f0e778d1b7164d57a6bc1c9e73ddf"} Jun 09 11:55:11.730752 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:11.730724 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"52842961935a2cccea330d87ce103a60fc68fd568ef5c4e0898016671edb40d6"} Jun 09 11:55:11.756760 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:11.756713 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrmfd" podStartSLOduration=4.694028093 podStartE2EDuration="25.756685639s" totalImagesPullingTime="21.062657546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:11.756419526 +0000 UTC m=+25.676302033" watchObservedRunningTime="2026-06-09 11:55:11.756685639 +0000 UTC m=+25.676568144" Jun 09 11:55:11.756977 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:11.756953 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fw5xn" podStartSLOduration=6.956867527 podStartE2EDuration="25.756946553s" totalImagesPullingTime="18.800079026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:10.761167948 +0000 UTC m=+24.681050454" watchObservedRunningTime="2026-06-09 11:55:11.756946553 +0000 UTC m=+25.676829058" Jun 09 11:55:12.282709 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.282662 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:55:12.283339 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.283312 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:55:12.556342 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.556306 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:12.556523 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.556311 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:12.556523 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:12.556431 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:12.556523 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.556445 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:12.556686 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:12.556552 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:12.556686 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:12.556616 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:12.733487 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.733457 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:55:12.734177 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:12.734047 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ctjk7" Jun 09 11:55:13.738852 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.738568 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" event={"ID":"c7e47718-ea2b-4777-bdb1-a574db2506f3","Type":"ContainerStarted","Data":"ce80996fa8a1dd72cdf852bd509048f53d4a41e5e76b822ce3321284a3f2a3d6"} Jun 09 11:55:13.739441 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.738924 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:13.739441 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.738981 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:13.740608 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.740572 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="4d38441c89f885adb13ee308378922c1c3afb3f34f055051556928c6a16ae311" exitCode=0 Jun 09 11:55:13.740740 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.740638 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"4d38441c89f885adb13ee308378922c1c3afb3f34f055051556928c6a16ae311"} Jun 09 11:55:13.754151 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.754131 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:13.776031 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:13.775989 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" podStartSLOduration=8.887758089 podStartE2EDuration="27.77597455s" totalImagesPullingTime="18.888216461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:13.77571667 +0000 UTC m=+27.695599177" watchObservedRunningTime="2026-06-09 11:55:13.77597455 +0000 UTC m=+27.695857065" Jun 09 11:55:14.556904 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:14.556873 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:14.557137 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:14.556880 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:14.557137 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:14.556992 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:14.557137 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:14.556878 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:14.557137 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:14.557124 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:14.557293 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:14.557213 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:14.742588 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:14.742552 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:14.757597 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:14.757572 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:15.587668 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.587443 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxl4m"] Jun 09 11:55:15.587962 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.587781 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:15.587962 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:15.587930 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:15.589026 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.588994 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9hsf"] Jun 09 11:55:15.589128 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.589094 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:15.589207 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:15.589187 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:15.589594 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.589575 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25wt8"] Jun 09 11:55:15.589732 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.589649 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:15.589809 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:15.589784 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:15.746451 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.746420 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="75b07641c9790744009b5ab5ebc747d22f5297c9774cc2655721849e7814ca08" exitCode=0 Jun 09 11:55:15.746835 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:15.746501 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"75b07641c9790744009b5ab5ebc747d22f5297c9774cc2655721849e7814ca08"} Jun 09 11:55:17.556791 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:17.556737 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:17.556791 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:17.556737 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:17.557261 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:17.556765 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:17.557261 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:17.556876 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:17.557261 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:17.556952 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:17.557261 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:17.557012 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:17.753724 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:17.753674 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="8c3fc6d55072ccddd7bdf318f79d16537150c4529cf0594d63186429d7230661" exitCode=0 Jun 09 11:55:17.753901 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:17.753719 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"8c3fc6d55072ccddd7bdf318f79d16537150c4529cf0594d63186429d7230661"} Jun 09 11:55:19.556282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:19.556245 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:19.557030 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:19.556389 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:19.557030 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:19.556393 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9hsf" podUID="dee4e79f-59da-474d-af00-6d44871932d0" Jun 09 11:55:19.557030 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:19.556395 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:19.557030 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:19.556498 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-25wt8" podUID="8a7903e8-8f8b-4b73-99b2-441ffce940a2" Jun 09 11:55:19.557030 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:19.556583 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:55:20.245879 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:20.245844 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:20.246035 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.245942 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:20.246035 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.245989 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret podName:8a7903e8-8f8b-4b73-99b2-441ffce940a2 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:52.245975821 +0000 UTC m=+66.165858305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret") pod "global-pull-secret-syncer-25wt8" (UID: "8a7903e8-8f8b-4b73-99b2-441ffce940a2") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:20.346530 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:20.346496 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:20.346712 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.346640 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:20.346778 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.346726 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:52.346685094 +0000 UTC m=+66.266567577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:20.447830 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:20.447796 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:20.448004 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.447908 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:20.448004 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.447923 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:20.448004 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.447931 2550 projected.go:196] Error preparing data for projected volume kube-api-access-qghgl for pod openshift-network-diagnostics/network-check-target-m9hsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:20.448004 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:20.447986 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl podName:dee4e79f-59da-474d-af00-6d44871932d0 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:52.447972223 +0000 UTC m=+66.367854706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qghgl" (UniqueName: "kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl") pod "network-check-target-m9hsf" (UID: "dee4e79f-59da-474d-af00-6d44871932d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:21.435065 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.435036 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-85.ec2.internal" event="NodeReady" Jun 09 11:55:21.435439 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.435180 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:55:21.495704 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.495670 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 11:55:21.527956 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.527930 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-644hz"] Jun 09 11:55:21.528116 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.528051 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.534531 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.534509 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:55:21.534910 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.534881 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:55:21.535023 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.534940 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qdxx\"" Jun 09 11:55:21.535205 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.535188 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:55:21.541020 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.540996 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:55:21.541905 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.541871 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 11:55:21.542013 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.541913 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hjngh"] Jun 09 11:55:21.542013 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.541996 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.545125 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.545103 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g5s4\"" Jun 09 11:55:21.545308 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.545294 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:55:21.545409 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.545388 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:55:21.558026 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558002 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-644hz"] Jun 09 11:55:21.558125 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558043 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjngh"] Jun 09 11:55:21.558125 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558102 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:21.558125 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558107 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:21.558257 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558102 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.558257 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.558207 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:21.561192 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.561172 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:55:21.563434 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.563357 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:55:21.563434 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.563388 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:55:21.563778 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.563728 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzslx\"" Jun 09 11:55:21.563778 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.563771 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:55:21.564003 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.563984 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bkch\"" Jun 09 11:55:21.564114 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.564052 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:55:21.564208 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.564187 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:55:21.564511 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.564193 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:55:21.564598 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.564358 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4tn98\"" Jun 09 11:55:21.655137 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655092 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655311 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655145 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.655311 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655169 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrgcl\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655311 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655198 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655311 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655285 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655510 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655347 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655510 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655383 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f409ddb-1c8b-4a17-aabe-913c52391236-config-volume\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.655510 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655420 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f409ddb-1c8b-4a17-aabe-913c52391236-tmp-dir\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.655510 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655443 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb9t8\" (UniqueName: \"kubernetes.io/projected/8f409ddb-1c8b-4a17-aabe-913c52391236-kube-api-access-fb9t8\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.655680 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655577 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655680 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655615 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655680 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655661 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.655849 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655718 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf32d0a-346d-4fbc-a55c-72f17657cc07-cert\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.655849 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.655744 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsxxt\" (UniqueName: \"kubernetes.io/projected/acf32d0a-346d-4fbc-a55c-72f17657cc07-kube-api-access-nsxxt\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.713102 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.712991 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.756928 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.756891 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757078 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.756928 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f409ddb-1c8b-4a17-aabe-913c52391236-config-volume\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757078 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757014 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f409ddb-1c8b-4a17-aabe-913c52391236-tmp-dir\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757078 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757049 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb9t8\" (UniqueName: \"kubernetes.io/projected/8f409ddb-1c8b-4a17-aabe-913c52391236-kube-api-access-fb9t8\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757098 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757119 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757143 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757204 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757169 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf32d0a-346d-4fbc-a55c-72f17657cc07-cert\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757313 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f409ddb-1c8b-4a17-aabe-913c52391236-tmp-dir\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757362 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsxxt\" (UniqueName: \"kubernetes.io/projected/acf32d0a-346d-4fbc-a55c-72f17657cc07-kube-api-access-nsxxt\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:21.757388 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757394 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:21.757406 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:21.757446 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757444 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:21.757458 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:22.257441025 +0000 UTC m=+36.177323532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757464 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757489 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrgcl\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757529 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757564 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f409ddb-1c8b-4a17-aabe-913c52391236-config-volume\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757573 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:21.757628 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:21.757668 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:22.257655445 +0000 UTC m=+36.177537937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:21.757769 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.757741 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.758339 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.758311 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.761197 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.761178 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.761281 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.761227 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.761320 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.761284 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acf32d0a-346d-4fbc-a55c-72f17657cc07-cert\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.768747 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.768725 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb9t8\" (UniqueName: \"kubernetes.io/projected/8f409ddb-1c8b-4a17-aabe-913c52391236-kube-api-access-fb9t8\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:21.768837 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.768725 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.772217 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.772195 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsxxt\" (UniqueName: \"kubernetes.io/projected/acf32d0a-346d-4fbc-a55c-72f17657cc07-kube-api-access-nsxxt\") pod \"ingress-canary-hjngh\" (UID: \"acf32d0a-346d-4fbc-a55c-72f17657cc07\") " pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.775476 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.775452 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrgcl\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:21.819307 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.819278 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.877510 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.877476 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjngh" Jun 09 11:55:21.894592 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:21.894572 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:22.096727 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.096678 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjngh"] Jun 09 11:55:22.100662 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:55:22.100640 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf32d0a_346d_4fbc_a55c_72f17657cc07.slice/crio-2866a4a066c65aa68de6f0735698d16ce57229b5d82950bfec119ca157e09fe0 WatchSource:0}: Error finding container 2866a4a066c65aa68de6f0735698d16ce57229b5d82950bfec119ca157e09fe0: Status 404 returned error can't find the container with id 2866a4a066c65aa68de6f0735698d16ce57229b5d82950bfec119ca157e09fe0 Jun 09 11:55:22.260844 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.260780 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:22.260844 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.260826 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:22.260981 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:22.260930 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:22.261015 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:22.260987 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:23.260972666 +0000 UTC m=+37.180855152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:22.261015 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:22.260934 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:22.261096 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:22.261023 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:22.261096 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:22.261062 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:23.261052602 +0000 UTC m=+37.180935093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:22.769551 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.769433 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="8b8e651d5af2ba5ab4cfa5813cf33dae2d5d160802848fca6c444ce6f3401b0e" exitCode=0 Jun 09 11:55:22.769551 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.769457 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"8b8e651d5af2ba5ab4cfa5813cf33dae2d5d160802848fca6c444ce6f3401b0e"} Jun 09 11:55:22.771004 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:22.770982 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjngh" event={"ID":"acf32d0a-346d-4fbc-a55c-72f17657cc07","Type":"ContainerStarted","Data":"2866a4a066c65aa68de6f0735698d16ce57229b5d82950bfec119ca157e09fe0"} Jun 09 11:55:23.268000 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:23.267962 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:23.268165 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:23.268056 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:23.268165 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:23.268126 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:23.268165 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:23.268150 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:23.268298 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:23.268182 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:23.268298 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:23.268220 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:25.268200611 +0000 UTC m=+39.188083116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:23.268298 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:23.268235 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:25.268228743 +0000 UTC m=+39.188111227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:23.777134 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:23.777095 2550 generic.go:356] "Generic (PLEG): container finished" podID="1da65db6-d300-45d8-98eb-f7e7a91a9490" containerID="e2676fc259e401b64f8743c70c28fa293c6e3fcb11cb83513b116572fe88c3ad" exitCode=0 Jun 09 11:55:23.777565 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:23.777145 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerDied","Data":"e2676fc259e401b64f8743c70c28fa293c6e3fcb11cb83513b116572fe88c3ad"} Jun 09 11:55:24.782251 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.782222 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qfdts" event={"ID":"1da65db6-d300-45d8-98eb-f7e7a91a9490","Type":"ContainerStarted","Data":"5104d6bbbca6015382ce313f1c25937ce715cc7bd241690f7e8e669489c24be6"} Jun 09 11:55:24.783682 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.783660 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjngh" event={"ID":"acf32d0a-346d-4fbc-a55c-72f17657cc07","Type":"ContainerStarted","Data":"93aa833767e7b7c2ab5661f87fed15e6209a6363597930929ed2656ad9fae50f"} Jun 09 11:55:24.807006 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.806953 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qfdts" podStartSLOduration=8.83336393 podStartE2EDuration="38.806933817s" totalImagesPullingTime="29.973569887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:24.805520894 +0000 UTC m=+38.725403425" watchObservedRunningTime="2026-06-09 11:55:24.806933817 +0000 UTC m=+38.726816327" Jun 09 11:55:24.829029 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.828990 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hjngh" podStartSLOduration=1.576650536 podStartE2EDuration="3.828976392s" totalImagesPullingTime="2.252325856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:24.828597961 +0000 UTC m=+38.748480468" watchObservedRunningTime="2026-06-09 11:55:24.828976392 +0000 UTC m=+38.748858876" Jun 09 11:55:24.930479 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.930448 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:24.993617 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:24.993590 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.283151 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:25.283110 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:25.283292 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:25.283169 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:25.283292 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:25.283260 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:25.283378 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:25.283295 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:25.283378 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:25.283309 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:25.283378 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:25.283321 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:29.283306597 +0000 UTC m=+43.203189081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:25.283378 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:25.283347 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:29.28333611 +0000 UTC m=+43.203218595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:25.941368 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:25.941189 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:26.006760 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:26.006732 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:29.312255 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:29.312210 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:29.312297 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:29.312375 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:29.312427 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:37.312413616 +0000 UTC m=+51.232296101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:29.312374 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:29.312470 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:29.312669 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:29.312509 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:37.312497584 +0000 UTC m=+51.232380073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:31.145459 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:31.145420 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:31.206797 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:31.206761 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:37.373745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:37.373706 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:37.373780 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:37.373874 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:37.373945 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:53.373929813 +0000 UTC m=+67.293812302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:37.373878 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:37.373970 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:37.374200 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:37.374018 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:53.374004342 +0000 UTC m=+67.293886827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:46.759068 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:46.759039 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ksqmz" Jun 09 11:55:52.274436 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.274375 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:52.277349 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.277329 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:55:52.288862 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.288835 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a7903e8-8f8b-4b73-99b2-441ffce940a2-original-pull-secret\") pod \"global-pull-secret-syncer-25wt8\" (UID: \"8a7903e8-8f8b-4b73-99b2-441ffce940a2\") " pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:52.375276 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.375221 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:55:52.377854 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.377833 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:55:52.385890 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:52.385873 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:55:52.385975 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:52.385957 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:56.38593431 +0000 UTC m=+130.305816794 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : secret "metrics-daemon-secret" not found Jun 09 11:55:52.475895 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.475863 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:52.478622 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.478603 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:55:52.485033 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.485019 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-25wt8" Jun 09 11:55:52.488167 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.488150 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:55:52.498472 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.498441 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qghgl\" (UniqueName: \"kubernetes.io/projected/dee4e79f-59da-474d-af00-6d44871932d0-kube-api-access-qghgl\") pod \"network-check-target-m9hsf\" (UID: \"dee4e79f-59da-474d-af00-6d44871932d0\") " pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:52.609005 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.608973 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-25wt8"] Jun 09 11:55:52.612126 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:55:52.612101 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7903e8_8f8b_4b73_99b2_441ffce940a2.slice/crio-1e833354692da8cf308550d9907f3ff47ef9fc340f7bf5c0d3958b8bcaba055f WatchSource:0}: Error finding container 1e833354692da8cf308550d9907f3ff47ef9fc340f7bf5c0d3958b8bcaba055f: Status 404 returned error can't find the container with id 1e833354692da8cf308550d9907f3ff47ef9fc340f7bf5c0d3958b8bcaba055f Jun 09 11:55:52.792189 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.792111 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bkch\"" Jun 09 11:55:52.800461 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.800442 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:52.848652 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.848588 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25wt8" event={"ID":"8a7903e8-8f8b-4b73-99b2-441ffce940a2","Type":"ContainerStarted","Data":"1e833354692da8cf308550d9907f3ff47ef9fc340f7bf5c0d3958b8bcaba055f"} Jun 09 11:55:52.934580 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:52.934549 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9hsf"] Jun 09 11:55:52.937930 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:55:52.937903 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee4e79f_59da_474d_af00_6d44871932d0.slice/crio-8d66f1d4bf9c0cd2e283390146fbfe04b0466148c0fe2f331ea50a8fd31a3814 WatchSource:0}: Error finding container 8d66f1d4bf9c0cd2e283390146fbfe04b0466148c0fe2f331ea50a8fd31a3814: Status 404 returned error can't find the container with id 8d66f1d4bf9c0cd2e283390146fbfe04b0466148c0fe2f331ea50a8fd31a3814 Jun 09 11:55:53.383021 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:53.382973 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:53.383042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:53.383153 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:53.383228 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:25.38320777 +0000 UTC m=+99.303090258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:53.383157 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:53.383269 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:55:53.383467 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:55:53.383327 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:25.383310117 +0000 UTC m=+99.303192817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:55:53.853792 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:53.853756 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9hsf" event={"ID":"dee4e79f-59da-474d-af00-6d44871932d0","Type":"ContainerStarted","Data":"8d66f1d4bf9c0cd2e283390146fbfe04b0466148c0fe2f331ea50a8fd31a3814"} Jun 09 11:55:57.865122 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:57.865038 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9hsf" event={"ID":"dee4e79f-59da-474d-af00-6d44871932d0","Type":"ContainerStarted","Data":"cb274f894a5910e22d650b7e16fe1c0196c549d351f28225573b8b3be9e90a00"} Jun 09 11:55:57.865601 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:57.865153 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:55:57.866747 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:57.866718 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-25wt8" event={"ID":"8a7903e8-8f8b-4b73-99b2-441ffce940a2","Type":"ContainerStarted","Data":"22b7aa3a4e621b21d2fdfac2cd75c84c4cec52d84774bfbd0086d7dca2251640"} Jun 09 11:55:57.880175 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:57.880131 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m9hsf" podStartSLOduration=67.228427562 podStartE2EDuration="1m11.880114582s" totalImagesPullingTime="4.65168702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:57.879304733 +0000 UTC m=+71.799187239" watchObservedRunningTime="2026-06-09 11:55:57.880114582 +0000 UTC m=+71.799997087" Jun 09 11:55:57.893129 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:55:57.893091 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-25wt8" podStartSLOduration=66.904168628 podStartE2EDuration="1m11.893077253s" totalImagesPullingTime="4.988908625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:57.892861642 +0000 UTC m=+71.812744148" watchObservedRunningTime="2026-06-09 11:55:57.893077253 +0000 UTC m=+71.812959759" Jun 09 11:56:25.404958 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:56:25.404853 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:56:25.404958 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:56:25.404916 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:56:25.405468 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:25.405010 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:25.405468 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:25.405030 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:56:25.405468 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:25.405044 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:56:25.405468 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:25.405079 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:29.405062096 +0000 UTC m=+163.324944580 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:56:25.405468 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:25.405110 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:29.405092047 +0000 UTC m=+163.324974551 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:56:28.871623 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:56:28.871586 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m9hsf" Jun 09 11:56:56.415504 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:56:56.415453 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:56:56.416113 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:56.415631 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:56:56.416113 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:56:56.415750 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 11:58:58.415729691 +0000 UTC m=+252.335612189 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : secret "metrics-daemon-secret" not found Jun 09 11:57:24.540041 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:24.539984 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-799f94d99b-c778j" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" Jun 09 11:57:24.552139 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:24.552110 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-644hz" podUID="8f409ddb-1c8b-4a17-aabe-913c52391236" Jun 09 11:57:24.570172 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:24.570146 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:57:25.065349 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:57:25.065309 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-644hz" Jun 09 11:57:25.065800 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:57:25.065777 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:57:29.440956 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:57:29.440902 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:57:29.440956 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:57:29.440970 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:57:29.441453 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:29.441058 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:57:29.441453 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:29.441069 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799f94d99b-c778j: secret "image-registry-tls" not found Jun 09 11:57:29.441453 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:29.441067 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:57:29.441453 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:29.441126 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls podName:74fdd365-bdb9-48e7-ad68-6706bcde6af5 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:31.441112034 +0000 UTC m=+285.360994519 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls") pod "image-registry-799f94d99b-c778j" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5") : secret "image-registry-tls" not found Jun 09 11:57:29.441453 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:57:29.441139 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls podName:8f409ddb-1c8b-4a17-aabe-913c52391236 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:31.441132518 +0000 UTC m=+285.361015002 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls") pod "dns-default-644hz" (UID: "8f409ddb-1c8b-4a17-aabe-913c52391236") : secret "dns-default-metrics-tls" not found Jun 09 11:57:36.557909 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:57:36.557829 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:58:58.455148 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:58:58.455094 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:58:58.455666 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:58:58.455245 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:58:58.455666 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:58:58.455322 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs podName:cb53e4e4-5938-46cd-bd99-90c67febaed3 nodeName:}" failed. No retries permitted until 2026-06-09 12:01:00.455305656 +0000 UTC m=+374.375188144 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs") pod "network-metrics-daemon-zxl4m" (UID: "cb53e4e4-5938-46cd-bd99-90c67febaed3") : secret "metrics-daemon-secret" not found Jun 09 11:59:05.956406 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.956372 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb"] Jun 09 11:59:05.969077 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.969056 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jj9n8"] Jun 09 11:59:05.969227 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.969202 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:05.971907 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.971866 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95"] Jun 09 11:59:05.972086 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.971957 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:05.973494 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.973472 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 11:59:05.973592 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.973472 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-t9cnz\"" Jun 09 11:59:05.973592 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.973560 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:59:05.974352 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.974327 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:59:05.974455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.974378 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 11:59:05.975032 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.975001 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb"] Jun 09 11:59:05.975134 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.975096 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" Jun 09 11:59:05.975893 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.975794 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jj9n8"] Jun 09 11:59:05.976720 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.976675 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95"] Jun 09 11:59:05.977069 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.977050 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gnmbk\"" Jun 09 11:59:05.977308 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.977078 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 11:59:05.977308 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.977078 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:05.977477 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.977449 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 11:59:05.977723 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.977706 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:05.979229 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.979208 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nhzdz\"" Jun 09 11:59:05.980018 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:05.979997 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 11:59:06.035158 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.035130 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf"] Jun 09 11:59:06.037922 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.037899 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-cfv2j"] Jun 09 11:59:06.038055 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.038034 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.040540 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.040522 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5857f9576f-9mmx4"] Jun 09 11:59:06.040649 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.040622 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.041021 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.041004 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:06.041117 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.041034 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:06.041322 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.041305 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 11:59:06.041772 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.041755 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 11:59:06.041853 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.041771 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2mcdm\"" Jun 09 11:59:06.043336 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.043316 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.043442 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.043421 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:59:06.043683 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.043653 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zfdqh\"" Jun 09 11:59:06.043871 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.043857 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:59:06.044250 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.044235 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 09 11:59:06.044306 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.044236 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 09 11:59:06.045363 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.045345 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 11:59:06.045555 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.045538 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 11:59:06.045628 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.045600 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 11:59:06.046010 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.045993 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 11:59:06.046087 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.046033 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 11:59:06.046087 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.046043 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 11:59:06.046431 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.046415 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-482s5\"" Jun 09 11:59:06.057471 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.057447 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf"] Jun 09 11:59:06.058449 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.058425 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-cfv2j"] Jun 09 11:59:06.058547 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.058492 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 09 11:59:06.060784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.060762 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5857f9576f-9mmx4"] Jun 09 11:59:06.112963 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.112889 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7285\" (UniqueName: \"kubernetes.io/projected/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-kube-api-access-j7285\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.112963 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.112924 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/822754f0-5188-4306-b13e-3299c46a5ae7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.112963 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.112949 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-serving-cert\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.113169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.112979 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.113169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.113003 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97ht\" (UniqueName: \"kubernetes.io/projected/fc75aff0-dbbe-4228-adea-919773deff78-kube-api-access-t97ht\") pod \"network-check-source-dbd9cf844-jnp95\" (UID: \"fc75aff0-dbbe-4228-adea-919773deff78\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" Jun 09 11:59:06.113169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.113028 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdk5v\" (UniqueName: \"kubernetes.io/projected/822754f0-5188-4306-b13e-3299c46a5ae7-kube-api-access-sdk5v\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.113169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.113074 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-config\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.113169 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.113104 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-trusted-ca\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.213732 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213632 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdk5v\" (UniqueName: \"kubernetes.io/projected/822754f0-5188-4306-b13e-3299c46a5ae7-kube-api-access-sdk5v\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.213732 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213666 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-config\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.213732 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213686 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-trusted-ca\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213732 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-trusted-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213763 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213785 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-tmp\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h46jv\" (UniqueName: \"kubernetes.io/projected/b0de5208-4781-4257-8633-b15043087ccd-kube-api-access-h46jv\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213848 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213873 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97ht\" (UniqueName: \"kubernetes.io/projected/fc75aff0-dbbe-4228-adea-919773deff78-kube-api-access-t97ht\") pod \"network-check-source-dbd9cf844-jnp95\" (UID: \"fc75aff0-dbbe-4228-adea-919773deff78\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213895 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3459c5e3-75e5-4330-b655-ece1e1c03f2a-serving-cert\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213925 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kn7l\" (UniqueName: \"kubernetes.io/projected/bafab310-40dd-42dc-aaa0-174d252ddd09-kube-api-access-6kn7l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.213958 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/822754f0-5188-4306-b13e-3299c46a5ae7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.213980 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.213967 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214040 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-serving-cert\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.214050 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.714029072 +0000 UTC m=+260.633911578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214098 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafab310-40dd-42dc-aaa0-174d252ddd09-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214144 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-default-certificate\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214178 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7285\" (UniqueName: \"kubernetes.io/projected/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-kube-api-access-j7285\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214218 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214272 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafab310-40dd-42dc-aaa0-174d252ddd09-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214305 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-stats-auth\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214373 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-service-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214413 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzsmn\" (UniqueName: \"kubernetes.io/projected/3459c5e3-75e5-4330-b655-ece1e1c03f2a-kube-api-access-qzsmn\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214444 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-config\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.214485 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214456 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-snapshots\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.215097 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214634 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-trusted-ca\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.215097 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.214679 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/822754f0-5188-4306-b13e-3299c46a5ae7-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.216498 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.216469 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-serving-cert\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.222265 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.222235 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7285\" (UniqueName: \"kubernetes.io/projected/5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d-kube-api-access-j7285\") pod \"console-operator-668fdbf85c-jj9n8\" (UID: \"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d\") " pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.222511 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.222494 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97ht\" (UniqueName: \"kubernetes.io/projected/fc75aff0-dbbe-4228-adea-919773deff78-kube-api-access-t97ht\") pod \"network-check-source-dbd9cf844-jnp95\" (UID: \"fc75aff0-dbbe-4228-adea-919773deff78\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" Jun 09 11:59:06.222569 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.222550 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdk5v\" (UniqueName: \"kubernetes.io/projected/822754f0-5188-4306-b13e-3299c46a5ae7-kube-api-access-sdk5v\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.287632 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.287605 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:06.292476 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.292454 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" Jun 09 11:59:06.315505 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315475 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-service-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.315505 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315509 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzsmn\" (UniqueName: \"kubernetes.io/projected/3459c5e3-75e5-4330-b655-ece1e1c03f2a-kube-api-access-qzsmn\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.315779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315529 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-snapshots\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.315779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315678 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-trusted-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.315779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315745 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.315779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315770 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-tmp\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315812 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h46jv\" (UniqueName: \"kubernetes.io/projected/b0de5208-4781-4257-8633-b15043087ccd-kube-api-access-h46jv\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315860 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3459c5e3-75e5-4330-b655-ece1e1c03f2a-serving-cert\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315889 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kn7l\" (UniqueName: \"kubernetes.io/projected/bafab310-40dd-42dc-aaa0-174d252ddd09-kube-api-access-6kn7l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315944 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafab310-40dd-42dc-aaa0-174d252ddd09-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.315990 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-default-certificate\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.316036 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316024 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316053 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafab310-40dd-42dc-aaa0-174d252ddd09-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316095 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-stats-auth\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.316105 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.316172 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.816154945 +0000 UTC m=+260.736037444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : secret "router-metrics-certs-default" not found Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316270 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-snapshots\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.316325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316288 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-service-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.316988 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.316735 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.816718211 +0000 UTC m=+260.736600697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:06.316988 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316747 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3459c5e3-75e5-4330-b655-ece1e1c03f2a-trusted-ca-bundle\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.316988 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.316772 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3459c5e3-75e5-4330-b655-ece1e1c03f2a-tmp\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.317308 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.317285 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafab310-40dd-42dc-aaa0-174d252ddd09-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.319241 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.318923 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3459c5e3-75e5-4330-b655-ece1e1c03f2a-serving-cert\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.319241 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.319178 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafab310-40dd-42dc-aaa0-174d252ddd09-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.319416 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.319323 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-stats-auth\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.319481 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.319446 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-default-certificate\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.324530 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.324509 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h46jv\" (UniqueName: \"kubernetes.io/projected/b0de5208-4781-4257-8633-b15043087ccd-kube-api-access-h46jv\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.324760 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.324742 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzsmn\" (UniqueName: \"kubernetes.io/projected/3459c5e3-75e5-4330-b655-ece1e1c03f2a-kube-api-access-qzsmn\") pod \"insights-operator-896549976-cfv2j\" (UID: \"3459c5e3-75e5-4330-b655-ece1e1c03f2a\") " pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.325406 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.325356 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kn7l\" (UniqueName: \"kubernetes.io/projected/bafab310-40dd-42dc-aaa0-174d252ddd09-kube-api-access-6kn7l\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-k9mvf\" (UID: \"bafab310-40dd-42dc-aaa0-174d252ddd09\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.348851 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.348815 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" Jun 09 11:59:06.359088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.358884 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-cfv2j" Jun 09 11:59:06.428994 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.428919 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jj9n8"] Jun 09 11:59:06.434422 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:06.434356 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5343f490_1ad6_4dce_bcf9_f31fa7ec8f4d.slice/crio-8ef59cf00cc62c10e3117eb7785d82229baec155791864b4203313b8fc858cb0 WatchSource:0}: Error finding container 8ef59cf00cc62c10e3117eb7785d82229baec155791864b4203313b8fc858cb0: Status 404 returned error can't find the container with id 8ef59cf00cc62c10e3117eb7785d82229baec155791864b4203313b8fc858cb0 Jun 09 11:59:06.448283 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.448221 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95"] Jun 09 11:59:06.452144 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:06.452096 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc75aff0_dbbe_4228_adea_919773deff78.slice/crio-3a58cb08b17d4d94489b3bf10b0059cf2e01ec9e2c1fffe3f32e85447b6d80f1 WatchSource:0}: Error finding container 3a58cb08b17d4d94489b3bf10b0059cf2e01ec9e2c1fffe3f32e85447b6d80f1: Status 404 returned error can't find the container with id 3a58cb08b17d4d94489b3bf10b0059cf2e01ec9e2c1fffe3f32e85447b6d80f1 Jun 09 11:59:06.499351 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.499208 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf"] Jun 09 11:59:06.507452 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:06.507425 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafab310_40dd_42dc_aaa0_174d252ddd09.slice/crio-8925cfe869b918247d93cf8f0fb5d696eb49ca6d3676d250964931781478795a WatchSource:0}: Error finding container 8925cfe869b918247d93cf8f0fb5d696eb49ca6d3676d250964931781478795a: Status 404 returned error can't find the container with id 8925cfe869b918247d93cf8f0fb5d696eb49ca6d3676d250964931781478795a Jun 09 11:59:06.518148 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.518129 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-cfv2j"] Jun 09 11:59:06.521207 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:06.521185 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3459c5e3_75e5_4330_b655_ece1e1c03f2a.slice/crio-8485090fc1bba094b44c38932593226ac056a42871ae5990918e8583a4423457 WatchSource:0}: Error finding container 8485090fc1bba094b44c38932593226ac056a42871ae5990918e8583a4423457: Status 404 returned error can't find the container with id 8485090fc1bba094b44c38932593226ac056a42871ae5990918e8583a4423457 Jun 09 11:59:06.718240 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.718207 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:06.718425 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.718348 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:06.718425 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.718408 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.71839356 +0000 UTC m=+261.638276048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:06.819408 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.819377 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.819556 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:06.819442 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:06.819556 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.819538 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:06.819556 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.819550 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.819532093 +0000 UTC m=+261.739414590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:06.819686 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:06.819576 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.819565234 +0000 UTC m=+261.739447724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : secret "router-metrics-certs-default" not found Jun 09 11:59:07.293947 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.293866 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" event={"ID":"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d","Type":"ContainerStarted","Data":"8ef59cf00cc62c10e3117eb7785d82229baec155791864b4203313b8fc858cb0"} Jun 09 11:59:07.296344 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.296272 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-cfv2j" event={"ID":"3459c5e3-75e5-4330-b655-ece1e1c03f2a","Type":"ContainerStarted","Data":"8485090fc1bba094b44c38932593226ac056a42871ae5990918e8583a4423457"} Jun 09 11:59:07.299260 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.299160 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" event={"ID":"bafab310-40dd-42dc-aaa0-174d252ddd09","Type":"ContainerStarted","Data":"8925cfe869b918247d93cf8f0fb5d696eb49ca6d3676d250964931781478795a"} Jun 09 11:59:07.301249 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.301201 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" event={"ID":"fc75aff0-dbbe-4228-adea-919773deff78","Type":"ContainerStarted","Data":"3e245674a08d6971748e1e3e9efe0bd9e0fac1ad7ebba794dbfe3532df488203"} Jun 09 11:59:07.301249 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.301241 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" event={"ID":"fc75aff0-dbbe-4228-adea-919773deff78","Type":"ContainerStarted","Data":"3a58cb08b17d4d94489b3bf10b0059cf2e01ec9e2c1fffe3f32e85447b6d80f1"} Jun 09 11:59:07.322787 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.322573 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-jnp95" podStartSLOduration=2.322555323 podStartE2EDuration="2.322555323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:07.321243907 +0000 UTC m=+261.241126412" watchObservedRunningTime="2026-06-09 11:59:07.322555323 +0000 UTC m=+261.242437809" Jun 09 11:59:07.728351 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.728301 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:07.728516 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:07.728443 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:07.728516 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:07.728508 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.728490064 +0000 UTC m=+263.648372564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:07.829952 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.829668 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:07.829952 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:07.829790 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:07.829952 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:07.829799 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:07.829952 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:07.829850 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.829833367 +0000 UTC m=+263.749715858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : secret "router-metrics-certs-default" not found Jun 09 11:59:07.829952 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:07.829893 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.829883197 +0000 UTC m=+263.749765682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:09.746351 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:09.746321 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:09.746732 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:09.746455 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:09.746732 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:09.746518 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.746504248 +0000 UTC m=+267.666386733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:09.847009 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:09.846941 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:09.847009 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:09.847009 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:09.847195 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:09.847123 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:09.847195 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:09.847177 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.847160702 +0000 UTC m=+267.767043187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : secret "router-metrics-certs-default" not found Jun 09 11:59:09.847195 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:09.847191 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.847184058 +0000 UTC m=+267.767066542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:10.314017 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.313982 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-cfv2j" event={"ID":"3459c5e3-75e5-4330-b655-ece1e1c03f2a","Type":"ContainerStarted","Data":"d7be1d0642177c7eb51c10d526a34e799d515be3b4ebddfed265b669e24f81bc"} Jun 09 11:59:10.315490 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.315456 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" event={"ID":"bafab310-40dd-42dc-aaa0-174d252ddd09","Type":"ContainerStarted","Data":"fdf37b1ff415bb07bead6f28186a2903a665a3cc13669a8bc2690b185bcd9152"} Jun 09 11:59:10.317009 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.316991 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/0.log" Jun 09 11:59:10.317104 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.317024 2550 generic.go:356] "Generic (PLEG): container finished" podID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" containerID="bad1845f1a7c73e85950e5b861414abdf1f5f3236d40464f48fee31e645d92c4" exitCode=255 Jun 09 11:59:10.317104 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.317048 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" event={"ID":"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d","Type":"ContainerDied","Data":"bad1845f1a7c73e85950e5b861414abdf1f5f3236d40464f48fee31e645d92c4"} Jun 09 11:59:10.317306 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.317289 2550 scope.go:117] "RemoveContainer" containerID="bad1845f1a7c73e85950e5b861414abdf1f5f3236d40464f48fee31e645d92c4" Jun 09 11:59:10.336568 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.336522 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-cfv2j" podStartSLOduration=1.284275792 podStartE2EDuration="4.336507011s" totalImagesPullingTime="3.052231219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:10.335287522 +0000 UTC m=+264.255170029" watchObservedRunningTime="2026-06-09 11:59:10.336507011 +0000 UTC m=+264.256389517" Jun 09 11:59:10.355220 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:10.355164 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" podStartSLOduration=1.283705246 podStartE2EDuration="4.355142367s" totalImagesPullingTime="3.071437121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:10.353835638 +0000 UTC m=+264.273718144" watchObservedRunningTime="2026-06-09 11:59:10.355142367 +0000 UTC m=+264.275024874" Jun 09 11:59:11.321760 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.321725 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/1.log" Jun 09 11:59:11.322187 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.322155 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/0.log" Jun 09 11:59:11.322229 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.322191 2550 generic.go:356] "Generic (PLEG): container finished" podID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" exitCode=255 Jun 09 11:59:11.322290 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.322272 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" event={"ID":"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d","Type":"ContainerDied","Data":"418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb"} Jun 09 11:59:11.322329 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.322322 2550 scope.go:117] "RemoveContainer" containerID="bad1845f1a7c73e85950e5b861414abdf1f5f3236d40464f48fee31e645d92c4" Jun 09 11:59:11.322540 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:11.322512 2550 scope.go:117] "RemoveContainer" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" Jun 09 11:59:11.322744 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:11.322722 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jj9n8_openshift-console-operator(5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podUID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" Jun 09 11:59:12.330859 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.330834 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/1.log" Jun 09 11:59:12.331232 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.331118 2550 scope.go:117] "RemoveContainer" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" Jun 09 11:59:12.331273 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:12.331251 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jj9n8_openshift-console-operator(5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podUID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" Jun 09 11:59:12.573040 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.573009 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-txxgs"] Jun 09 11:59:12.576963 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.576949 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.583082 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.583061 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 11:59:12.583193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.583092 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 11:59:12.583193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.583160 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pjwhf\"" Jun 09 11:59:12.583301 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.583193 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 11:59:12.583301 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.583273 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 11:59:12.586950 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.586929 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-txxgs"] Jun 09 11:59:12.671073 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.671045 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7g6\" (UniqueName: \"kubernetes.io/projected/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-kube-api-access-ff7g6\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.671233 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.671087 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-key\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.671233 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.671115 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-cabundle\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.772006 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.771957 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7g6\" (UniqueName: \"kubernetes.io/projected/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-kube-api-access-ff7g6\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.772164 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.772041 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-key\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.772164 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.772082 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-cabundle\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.772779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.772760 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-cabundle\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.774468 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.774447 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-signing-key\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.780101 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.780073 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7g6\" (UniqueName: \"kubernetes.io/projected/cdf5cc28-dc0c-4685-959c-03a5f3389bf8-kube-api-access-ff7g6\") pod \"service-ca-7d74d578b8-txxgs\" (UID: \"cdf5cc28-dc0c-4685-959c-03a5f3389bf8\") " pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:12.885014 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:12.884948 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" Jun 09 11:59:13.013526 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.013496 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-txxgs"] Jun 09 11:59:13.018133 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:13.018105 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf5cc28_dc0c_4685_959c_03a5f3389bf8.slice/crio-456987abd0f3d3b3e101d8b0a01704cfce4df937743777764ebd2246cd3f5e99 WatchSource:0}: Error finding container 456987abd0f3d3b3e101d8b0a01704cfce4df937743777764ebd2246cd3f5e99: Status 404 returned error can't find the container with id 456987abd0f3d3b3e101d8b0a01704cfce4df937743777764ebd2246cd3f5e99 Jun 09 11:59:13.335999 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.335960 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" event={"ID":"cdf5cc28-dc0c-4685-959c-03a5f3389bf8","Type":"ContainerStarted","Data":"456987abd0f3d3b3e101d8b0a01704cfce4df937743777764ebd2246cd3f5e99"} Jun 09 11:59:13.778210 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.778177 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:13.778377 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:13.778327 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:13.778439 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:13.778404 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.77838314 +0000 UTC m=+275.698265628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:13.854088 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.854056 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcn4t_4c3b6ba0-5cac-4173-89ff-0eb8a293430a/dns-node-resolver/0.log" Jun 09 11:59:13.878805 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.878769 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:13.878955 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:13.878925 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 11:59:13.879033 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:13.878972 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:13.879033 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:13.878992 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.87897171 +0000 UTC m=+275.798854213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : secret "router-metrics-certs-default" not found Jun 09 11:59:13.879127 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:13.879092 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle podName:b0de5208-4781-4257-8633-b15043087ccd nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.879073334 +0000 UTC m=+275.798955824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle") pod "router-default-5857f9576f-9mmx4" (UID: "b0de5208-4781-4257-8633-b15043087ccd") : configmap references non-existent config key: service-ca.crt Jun 09 11:59:14.653939 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:14.653905 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgqkx_f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c/node-ca/0.log" Jun 09 11:59:15.344437 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:15.344407 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" event={"ID":"cdf5cc28-dc0c-4685-959c-03a5f3389bf8","Type":"ContainerStarted","Data":"ea72c67cb63ac0b8a31fcec45e65e65027dd62286d73b7de489f64ee00097d6c"} Jun 09 11:59:15.366005 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:15.365952 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-txxgs" podStartSLOduration=1.894019015 podStartE2EDuration="3.365936484s" totalImagesPullingTime="1.471917469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:15.364210224 +0000 UTC m=+269.284092730" watchObservedRunningTime="2026-06-09 11:59:15.365936484 +0000 UTC m=+269.285819043" Jun 09 11:59:15.654044 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:15.653963 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjngh_acf32d0a-346d-4fbc-a55c-72f17657cc07/serve-healthcheck-canary/0.log" Jun 09 11:59:16.288226 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:16.288141 2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:16.288226 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:16.288204 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:16.288629 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:16.288615 2550 scope.go:117] "RemoveContainer" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" Jun 09 11:59:16.288841 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:16.288819 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jj9n8_openshift-console-operator(5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podUID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" Jun 09 11:59:21.843039 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.842993 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:21.843516 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:21.843137 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:21.843516 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:21.843213 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls podName:822754f0-5188-4306-b13e-3299c46a5ae7 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:37.843198538 +0000 UTC m=+291.763081022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ztnmb" (UID: "822754f0-5188-4306-b13e-3299c46a5ae7") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:59:21.943592 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.943557 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:21.943766 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.943624 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:21.944354 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.944333 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0de5208-4781-4257-8633-b15043087ccd-service-ca-bundle\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:21.945942 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.945924 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5208-4781-4257-8633-b15043087ccd-metrics-certs\") pod \"router-default-5857f9576f-9mmx4\" (UID: \"b0de5208-4781-4257-8633-b15043087ccd\") " pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:21.964823 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:21.964796 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:22.090970 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.090941 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5857f9576f-9mmx4"] Jun 09 11:59:22.094407 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:22.094335 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0de5208_4781_4257_8633_b15043087ccd.slice/crio-b6f6add23f00679ef58fb6c667787726e135664037acdc6d511e3b9876ee2b9d WatchSource:0}: Error finding container b6f6add23f00679ef58fb6c667787726e135664037acdc6d511e3b9876ee2b9d: Status 404 returned error can't find the container with id b6f6add23f00679ef58fb6c667787726e135664037acdc6d511e3b9876ee2b9d Jun 09 11:59:22.366871 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.366793 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5857f9576f-9mmx4" event={"ID":"b0de5208-4781-4257-8633-b15043087ccd","Type":"ContainerStarted","Data":"e4a3818ac14503769da8c9c352486fe07bb67909a451edf8150c4cf4ab6f9fa0"} Jun 09 11:59:22.366871 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.366842 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5857f9576f-9mmx4" event={"ID":"b0de5208-4781-4257-8633-b15043087ccd","Type":"ContainerStarted","Data":"b6f6add23f00679ef58fb6c667787726e135664037acdc6d511e3b9876ee2b9d"} Jun 09 11:59:22.385251 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.385206 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5857f9576f-9mmx4" podStartSLOduration=16.385191206000002 podStartE2EDuration="16.385191206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:22.383945764 +0000 UTC m=+276.303828270" watchObservedRunningTime="2026-06-09 11:59:22.385191206 +0000 UTC m=+276.305073757" Jun 09 11:59:22.965438 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.965398 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:22.967962 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:22.967936 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:23.370045 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:23.369960 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:23.371200 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:23.371176 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5857f9576f-9mmx4" Jun 09 11:59:28.066116 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:28.066068 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-644hz" podUID="8f409ddb-1c8b-4a17-aabe-913c52391236" Jun 09 11:59:28.066553 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:28.066259 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-799f94d99b-c778j" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" Jun 09 11:59:28.384379 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:28.384303 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-644hz" Jun 09 11:59:28.384379 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:28.384339 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:28.559528 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:28.559501 2550 scope.go:117] "RemoveContainer" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" Jun 09 11:59:29.389044 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389013 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 11:59:29.389499 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389419 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/1.log" Jun 09 11:59:29.389499 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389457 2550 generic.go:356] "Generic (PLEG): container finished" podID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" containerID="777682fa6b08ed5901c36a6a6cceaa156dd6004bc587c6a8babc50a1350f30ab" exitCode=255 Jun 09 11:59:29.389620 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389512 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" event={"ID":"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d","Type":"ContainerDied","Data":"777682fa6b08ed5901c36a6a6cceaa156dd6004bc587c6a8babc50a1350f30ab"} Jun 09 11:59:29.389620 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389570 2550 scope.go:117] "RemoveContainer" containerID="418cb10fa01682e41b0d30feb39be238c15b251d9dadf41431b92b6e0d19d4cb" Jun 09 11:59:29.389920 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:29.389899 2550 scope.go:117] "RemoveContainer" containerID="777682fa6b08ed5901c36a6a6cceaa156dd6004bc587c6a8babc50a1350f30ab" Jun 09 11:59:29.390095 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:29.390075 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jj9n8_openshift-console-operator(5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podUID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" Jun 09 11:59:30.394056 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:30.394029 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 11:59:31.515400 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.515366 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:31.515911 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.515412 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:59:31.517778 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.517756 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"image-registry-799f94d99b-c778j\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:31.517778 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.517768 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f409ddb-1c8b-4a17-aabe-913c52391236-metrics-tls\") pod \"dns-default-644hz\" (UID: \"8f409ddb-1c8b-4a17-aabe-913c52391236\") " pod="openshift-dns/dns-default-644hz" Jun 09 11:59:31.689151 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.689123 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g5s4\"" Jun 09 11:59:31.689151 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.689123 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qdxx\"" Jun 09 11:59:31.696325 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.696301 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-644hz" Jun 09 11:59:31.696409 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.696391 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:31.832503 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.832467 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 11:59:31.836306 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:31.836276 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fdd365_bdb9_48e7_ad68_6706bcde6af5.slice/crio-5125722f6bb83fa7355c4f34a5aaa4906d9152826e49d224d6aee6615b16c79b WatchSource:0}: Error finding container 5125722f6bb83fa7355c4f34a5aaa4906d9152826e49d224d6aee6615b16c79b: Status 404 returned error can't find the container with id 5125722f6bb83fa7355c4f34a5aaa4906d9152826e49d224d6aee6615b16c79b Jun 09 11:59:31.846933 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:31.846870 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-644hz"] Jun 09 11:59:31.849460 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:31.849436 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f409ddb_1c8b_4a17_aabe_913c52391236.slice/crio-0d89b1eecf4c070662fca90fdc587fe7fef471608b818eb806cc32ef88b28b5b WatchSource:0}: Error finding container 0d89b1eecf4c070662fca90fdc587fe7fef471608b818eb806cc32ef88b28b5b: Status 404 returned error can't find the container with id 0d89b1eecf4c070662fca90fdc587fe7fef471608b818eb806cc32ef88b28b5b Jun 09 11:59:32.401924 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:32.401890 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-644hz" event={"ID":"8f409ddb-1c8b-4a17-aabe-913c52391236","Type":"ContainerStarted","Data":"0d89b1eecf4c070662fca90fdc587fe7fef471608b818eb806cc32ef88b28b5b"} Jun 09 11:59:32.403772 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:32.403745 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f94d99b-c778j" event={"ID":"74fdd365-bdb9-48e7-ad68-6706bcde6af5","Type":"ContainerStarted","Data":"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34"} Jun 09 11:59:32.403917 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:32.403788 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f94d99b-c778j" event={"ID":"74fdd365-bdb9-48e7-ad68-6706bcde6af5","Type":"ContainerStarted","Data":"5125722f6bb83fa7355c4f34a5aaa4906d9152826e49d224d6aee6615b16c79b"} Jun 09 11:59:32.403965 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:32.403931 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:32.424329 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:32.424285 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-799f94d99b-c778j" podStartSLOduration=285.424272065 podStartE2EDuration="4m45.424272065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:32.424247585 +0000 UTC m=+286.344130092" watchObservedRunningTime="2026-06-09 11:59:32.424272065 +0000 UTC m=+286.344154571" Jun 09 11:59:33.580720 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.580677 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vcq85"] Jun 09 11:59:33.603139 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.603044 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.605902 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.605874 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcq85"] Jun 09 11:59:33.607353 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.607328 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgjb4\"" Jun 09 11:59:33.607731 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.607713 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:59:33.610159 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.609989 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:59:33.733031 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.732997 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/930cfeca-f597-4f4c-b27b-f1454942455e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.733031 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.733034 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/930cfeca-f597-4f4c-b27b-f1454942455e-crio-socket\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.733237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.733126 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/930cfeca-f597-4f4c-b27b-f1454942455e-data-volume\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.733237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.733171 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd4nn\" (UniqueName: \"kubernetes.io/projected/930cfeca-f597-4f4c-b27b-f1454942455e-kube-api-access-dd4nn\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.733237 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.733191 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/930cfeca-f597-4f4c-b27b-f1454942455e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834053 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.833970 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/930cfeca-f597-4f4c-b27b-f1454942455e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834053 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834011 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/930cfeca-f597-4f4c-b27b-f1454942455e-crio-socket\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834073 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/930cfeca-f597-4f4c-b27b-f1454942455e-data-volume\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834106 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd4nn\" (UniqueName: \"kubernetes.io/projected/930cfeca-f597-4f4c-b27b-f1454942455e-kube-api-access-dd4nn\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834131 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/930cfeca-f597-4f4c-b27b-f1454942455e-crio-socket\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834278 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834134 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/930cfeca-f597-4f4c-b27b-f1454942455e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834482 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834371 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/930cfeca-f597-4f4c-b27b-f1454942455e-data-volume\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.834535 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.834513 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/930cfeca-f597-4f4c-b27b-f1454942455e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.836371 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.836349 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/930cfeca-f597-4f4c-b27b-f1454942455e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.845174 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.845152 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd4nn\" (UniqueName: \"kubernetes.io/projected/930cfeca-f597-4f4c-b27b-f1454942455e-kube-api-access-dd4nn\") pod \"insights-runtime-extractor-vcq85\" (UID: \"930cfeca-f597-4f4c-b27b-f1454942455e\") " pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:33.915439 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:33.915408 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vcq85" Jun 09 11:59:34.259810 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:34.259785 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vcq85"] Jun 09 11:59:34.262028 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:34.262006 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930cfeca_f597_4f4c_b27b_f1454942455e.slice/crio-0b1598ecf8d0a8866702c85c800e614dbe726518b5fb5f6473e244130c7b93ea WatchSource:0}: Error finding container 0b1598ecf8d0a8866702c85c800e614dbe726518b5fb5f6473e244130c7b93ea: Status 404 returned error can't find the container with id 0b1598ecf8d0a8866702c85c800e614dbe726518b5fb5f6473e244130c7b93ea Jun 09 11:59:34.414580 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:34.414549 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcq85" event={"ID":"930cfeca-f597-4f4c-b27b-f1454942455e","Type":"ContainerStarted","Data":"3c7b72bd719a8ddf1bc60fcebd418ac4be3ab5b675744cde1ee76962a6050876"} Jun 09 11:59:34.414721 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:34.414606 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcq85" event={"ID":"930cfeca-f597-4f4c-b27b-f1454942455e","Type":"ContainerStarted","Data":"0b1598ecf8d0a8866702c85c800e614dbe726518b5fb5f6473e244130c7b93ea"} Jun 09 11:59:34.416183 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:34.416158 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-644hz" event={"ID":"8f409ddb-1c8b-4a17-aabe-913c52391236","Type":"ContainerStarted","Data":"d2baad8d7eb9e7fcae2c7ac7ed15a75f399665f72a606cab91682cf15fbec5df"} Jun 09 11:59:35.421934 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:35.421845 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-644hz" event={"ID":"8f409ddb-1c8b-4a17-aabe-913c52391236","Type":"ContainerStarted","Data":"11b186f9c5176ef89cdbb5ac6c4015654bafc604a35c5ac858bd540391ce9b11"} Jun 09 11:59:35.422379 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:35.422020 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-644hz" Jun 09 11:59:35.423643 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:35.423617 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcq85" event={"ID":"930cfeca-f597-4f4c-b27b-f1454942455e","Type":"ContainerStarted","Data":"bd42ee52d9ac8be3aa7213175490fe135fe47ef989f77b50d4677df3e0a0624f"} Jun 09 11:59:35.438918 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:35.438877 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-644hz" podStartSLOduration=252.16508871 podStartE2EDuration="4m14.438862152s" totalImagesPullingTime="2.273773442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:35.438478765 +0000 UTC m=+289.358361273" watchObservedRunningTime="2026-06-09 11:59:35.438862152 +0000 UTC m=+289.358744659" Jun 09 11:59:36.288126 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:36.288088 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:36.288289 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:36.288149 2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:36.288447 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:36.288434 2550 scope.go:117] "RemoveContainer" containerID="777682fa6b08ed5901c36a6a6cceaa156dd6004bc587c6a8babc50a1350f30ab" Jun 09 11:59:36.288597 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:36.288580 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jj9n8_openshift-console-operator(5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podUID="5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d" Jun 09 11:59:36.428929 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:36.428892 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vcq85" event={"ID":"930cfeca-f597-4f4c-b27b-f1454942455e","Type":"ContainerStarted","Data":"9f8511b27aef7528eac6974d258d8af96783d8a948fbd055329da7ef190678ff"} Jun 09 11:59:36.447931 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:36.447881 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vcq85" podStartSLOduration=1.601634079 podStartE2EDuration="3.447864306s" totalImagesPullingTime="1.846230227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:36.447680553 +0000 UTC m=+290.367563040" watchObservedRunningTime="2026-06-09 11:59:36.447864306 +0000 UTC m=+290.367746812" Jun 09 11:59:37.869243 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:37.869206 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:37.871518 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:37.871487 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/822754f0-5188-4306-b13e-3299c46a5ae7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ztnmb\" (UID: \"822754f0-5188-4306-b13e-3299c46a5ae7\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:38.081875 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:38.081838 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" Jun 09 11:59:38.207511 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:38.207482 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb"] Jun 09 11:59:38.210200 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:38.210176 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822754f0_5188_4306_b13e_3299c46a5ae7.slice/crio-e780c12470ec5ca298b39624096497ac08c80637902aeb06b5372346e2e2cedc WatchSource:0}: Error finding container e780c12470ec5ca298b39624096497ac08c80637902aeb06b5372346e2e2cedc: Status 404 returned error can't find the container with id e780c12470ec5ca298b39624096497ac08c80637902aeb06b5372346e2e2cedc Jun 09 11:59:38.435776 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:38.435740 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" event={"ID":"822754f0-5188-4306-b13e-3299c46a5ae7","Type":"ContainerStarted","Data":"e780c12470ec5ca298b39624096497ac08c80637902aeb06b5372346e2e2cedc"} Jun 09 11:59:39.559291 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:39.559244 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zxl4m" podUID="cb53e4e4-5938-46cd-bd99-90c67febaed3" Jun 09 11:59:40.444356 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:40.444321 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" event={"ID":"822754f0-5188-4306-b13e-3299c46a5ae7","Type":"ContainerStarted","Data":"a77793b753f4d68f7318b0b97fe2a715926f5c675354a2d1d73444f56aeefd11"} Jun 09 11:59:40.462836 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:40.462790 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ztnmb" podStartSLOduration=33.94620848 podStartE2EDuration="35.462772385s" totalImagesPullingTime="1.516563905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:40.461144599 +0000 UTC m=+294.381027109" watchObservedRunningTime="2026-06-09 11:59:40.462772385 +0000 UTC m=+294.382654891" Jun 09 11:59:43.286287 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.286255 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz"] Jun 09 11:59:43.289549 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.289530 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.294188 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.294168 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 11:59:43.294333 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.294186 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6gnb5\"" Jun 09 11:59:43.295333 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.295309 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 11:59:43.295452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.295374 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:59:43.299213 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.299184 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz"] Jun 09 11:59:43.416557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.416523 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682nv\" (UniqueName: \"kubernetes.io/projected/e5994382-e149-4265-a4d6-58522e27e9c1-kube-api-access-682nv\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.416557 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.416559 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.416810 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.416621 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.416810 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.416728 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5994382-e149-4265-a4d6-58522e27e9c1-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.518011 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.517981 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5994382-e149-4265-a4d6-58522e27e9c1-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.518011 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.518016 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682nv\" (UniqueName: \"kubernetes.io/projected/e5994382-e149-4265-a4d6-58522e27e9c1-kube-api-access-682nv\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.518233 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.518046 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.518233 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.518091 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.518784 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.518751 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5994382-e149-4265-a4d6-58522e27e9c1-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.520488 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.520467 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.520590 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.520573 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e5994382-e149-4265-a4d6-58522e27e9c1-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.527376 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.527352 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-682nv\" (UniqueName: \"kubernetes.io/projected/e5994382-e149-4265-a4d6-58522e27e9c1-kube-api-access-682nv\") pod \"prometheus-operator-7f7d445d84-xlxzz\" (UID: \"e5994382-e149-4265-a4d6-58522e27e9c1\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.599839 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.599753 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" Jun 09 11:59:43.725622 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:43.725530 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz"] Jun 09 11:59:43.727897 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:43.727871 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5994382_e149_4265_a4d6_58522e27e9c1.slice/crio-b23139a89e55dcf682105a4ccaf2be4b4ef82a016244ca04beadbd0d7aad4885 WatchSource:0}: Error finding container b23139a89e55dcf682105a4ccaf2be4b4ef82a016244ca04beadbd0d7aad4885: Status 404 returned error can't find the container with id b23139a89e55dcf682105a4ccaf2be4b4ef82a016244ca04beadbd0d7aad4885 Jun 09 11:59:44.460829 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:44.460795 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" event={"ID":"e5994382-e149-4265-a4d6-58522e27e9c1","Type":"ContainerStarted","Data":"b23139a89e55dcf682105a4ccaf2be4b4ef82a016244ca04beadbd0d7aad4885"} Jun 09 11:59:45.431048 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:45.431018 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-644hz" Jun 09 11:59:45.466480 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:45.466448 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" event={"ID":"e5994382-e149-4265-a4d6-58522e27e9c1","Type":"ContainerStarted","Data":"ee5bfb56dff1daa7624e7397a44041186784833ac57551b3e2d96b1b2602ee37"} Jun 09 11:59:45.466860 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:45.466502 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" event={"ID":"e5994382-e149-4265-a4d6-58522e27e9c1","Type":"ContainerStarted","Data":"2e7c565f4ffa7392646a97b29a9b81068575e55077050a1961c7e04cc102dbda"} Jun 09 11:59:45.485779 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:45.485729 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xlxzz" podStartSLOduration=1.368062019 podStartE2EDuration="2.485683916s" totalImagesPullingTime="1.117621897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:45.484173501 +0000 UTC m=+299.404056006" watchObservedRunningTime="2026-06-09 11:59:45.485683916 +0000 UTC m=+299.405566422" Jun 09 11:59:46.499462 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:46.499432 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 11:59:46.500254 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:46.500235 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 11:59:46.514926 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:46.514902 2550 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 11:59:47.664603 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.664569 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9"] Jun 09 11:59:47.668095 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.668073 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.668588 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.668573 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kb4zk"] Jun 09 11:59:47.671009 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.670970 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:59:47.671009 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.671001 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 11:59:47.671189 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.671063 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 11:59:47.671497 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.671478 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.672965 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.672948 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6mm8p\"" Jun 09 11:59:47.673921 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.673904 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g8g9h\"" Jun 09 11:59:47.674139 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.674123 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:59:47.674431 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.674406 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:59:47.674601 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.674587 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:59:47.686632 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.686610 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9"] Jun 09 11:59:47.754753 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754714 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f343f79e-f821-4293-b8b0-91ffdf162900-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.754930 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754759 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.754930 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754857 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-wtmp\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.754930 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754893 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-metrics-client-ca\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.754930 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754918 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.754982 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-accelerators-collector-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755007 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snth2\" (UniqueName: \"kubernetes.io/projected/ee5540ec-89e6-420a-8503-81497d997feb-kube-api-access-snth2\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755029 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-sys\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-root\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755094 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-textfile\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.755144 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755129 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.755452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755182 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.755452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755237 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.755452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755255 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4zpd\" (UniqueName: \"kubernetes.io/projected/f343f79e-f821-4293-b8b0-91ffdf162900-kube-api-access-f4zpd\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.755452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.755276 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.855962 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.855923 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.855962 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.855960 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4zpd\" (UniqueName: \"kubernetes.io/projected/f343f79e-f821-4293-b8b0-91ffdf162900-kube-api-access-f4zpd\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.855981 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f343f79e-f821-4293-b8b0-91ffdf162900-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856037 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856085 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-wtmp\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:47.856094 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856114 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-metrics-client-ca\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856142 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.856193 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:47.856158 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls podName:ee5540ec-89e6-420a-8503-81497d997feb nodeName:}" failed. No retries permitted until 2026-06-09 11:59:48.356137173 +0000 UTC m=+302.276019674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls") pod "node-exporter-kb4zk" (UID: "ee5540ec-89e6-420a-8503-81497d997feb") : secret "node-exporter-tls" not found Jun 09 11:59:47.856604 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:47.856287 2550 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 09 11:59:47.856604 ip-10-0-129-85 kubenswrapper[2550]: E0609 11:59:47.856348 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls podName:f343f79e-f821-4293-b8b0-91ffdf162900 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:48.356333112 +0000 UTC m=+302.276215595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-r6sz9" (UID: "f343f79e-f821-4293-b8b0-91ffdf162900") : secret "kube-state-metrics-tls" not found Jun 09 11:59:47.856604 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856580 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f343f79e-f821-4293-b8b0-91ffdf162900-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.856949 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856793 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-metrics-client-ca\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.856949 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.856912 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-wtmp\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857184 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857164 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.857270 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857252 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-accelerators-collector-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857381 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857361 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snth2\" (UniqueName: \"kubernetes.io/projected/ee5540ec-89e6-420a-8503-81497d997feb-kube-api-access-snth2\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857390 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-sys\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857425 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-root\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857432 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-accelerators-collector-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857450 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-textfile\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857477 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857496 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-sys\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857514 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.857874 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857653 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ee5540ec-89e6-420a-8503-81497d997feb-root\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.857874 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.857727 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-textfile\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.858166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.858143 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.859011 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.858990 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:47.860008 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.859986 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.881040 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.881016 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4zpd\" (UniqueName: \"kubernetes.io/projected/f343f79e-f821-4293-b8b0-91ffdf162900-kube-api-access-f4zpd\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:47.883316 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:47.883287 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snth2\" (UniqueName: \"kubernetes.io/projected/ee5540ec-89e6-420a-8503-81497d997feb-kube-api-access-snth2\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:48.362060 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.362027 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:48.362060 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.362066 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:48.364430 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.364409 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ee5540ec-89e6-420a-8503-81497d997feb-node-exporter-tls\") pod \"node-exporter-kb4zk\" (UID: \"ee5540ec-89e6-420a-8503-81497d997feb\") " pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:48.364576 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.364555 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f343f79e-f821-4293-b8b0-91ffdf162900-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-r6sz9\" (UID: \"f343f79e-f821-4293-b8b0-91ffdf162900\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:48.580484 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.580450 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" Jun 09 11:59:48.586927 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.586265 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kb4zk" Jun 09 11:59:48.601289 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:48.601258 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5540ec_89e6_420a_8503_81497d997feb.slice/crio-cc3ae7721a7f77eb4c5943764ea2567e97b0e39627ade32d9313a9046cf81863 WatchSource:0}: Error finding container cc3ae7721a7f77eb4c5943764ea2567e97b0e39627ade32d9313a9046cf81863: Status 404 returned error can't find the container with id cc3ae7721a7f77eb4c5943764ea2567e97b0e39627ade32d9313a9046cf81863 Jun 09 11:59:48.603046 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.603029 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:59:48.732754 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:48.732719 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9"] Jun 09 11:59:48.736845 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:48.736814 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf343f79e_f821_4293_b8b0_91ffdf162900.slice/crio-a89a10d118ead3d87293d263897246635d85ffcb6f595291da96dd5f64637871 WatchSource:0}: Error finding container a89a10d118ead3d87293d263897246635d85ffcb6f595291da96dd5f64637871: Status 404 returned error can't find the container with id a89a10d118ead3d87293d263897246635d85ffcb6f595291da96dd5f64637871 Jun 09 11:59:49.480612 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:49.480584 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" event={"ID":"f343f79e-f821-4293-b8b0-91ffdf162900","Type":"ContainerStarted","Data":"a89a10d118ead3d87293d263897246635d85ffcb6f595291da96dd5f64637871"} Jun 09 11:59:49.489057 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:49.489011 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kb4zk" event={"ID":"ee5540ec-89e6-420a-8503-81497d997feb","Type":"ContainerStarted","Data":"cc3ae7721a7f77eb4c5943764ea2567e97b0e39627ade32d9313a9046cf81863"} Jun 09 11:59:50.495060 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.495024 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" event={"ID":"f343f79e-f821-4293-b8b0-91ffdf162900","Type":"ContainerStarted","Data":"d14470ad7a8422fc211147166ff6e9d73bc695d96efe4619868f67abcafb09b5"} Jun 09 11:59:50.495533 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.495093 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" event={"ID":"f343f79e-f821-4293-b8b0-91ffdf162900","Type":"ContainerStarted","Data":"2d703cecb688f5de55abb4de259633c110b732bec627001446b85c2ec50a23c1"} Jun 09 11:59:50.495533 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.495119 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" event={"ID":"f343f79e-f821-4293-b8b0-91ffdf162900","Type":"ContainerStarted","Data":"87ac4f66afd92b08c0ff07566dabb44664aad23a702798537a3a26e0c73b23f7"} Jun 09 11:59:50.496580 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.496554 2550 generic.go:356] "Generic (PLEG): container finished" podID="ee5540ec-89e6-420a-8503-81497d997feb" containerID="7d8c608ebada2df318ad056bb7da9cd55164907ab240c0f898b15da3dba3f399" exitCode=0 Jun 09 11:59:50.496745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.496600 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kb4zk" event={"ID":"ee5540ec-89e6-420a-8503-81497d997feb","Type":"ContainerDied","Data":"7d8c608ebada2df318ad056bb7da9cd55164907ab240c0f898b15da3dba3f399"} Jun 09 11:59:50.517653 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.517611 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-r6sz9" podStartSLOduration=2.411007102 podStartE2EDuration="3.517595058s" totalImagesPullingTime="1.106587956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:50.516391744 +0000 UTC m=+304.436274242" watchObservedRunningTime="2026-06-09 11:59:50.517595058 +0000 UTC m=+304.437477565" Jun 09 11:59:50.556618 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:50.556592 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 11:59:51.502346 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.502309 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kb4zk" event={"ID":"ee5540ec-89e6-420a-8503-81497d997feb","Type":"ContainerStarted","Data":"60549d785dc37a3ac3f35b688e58d89f1a690ceb7e951ad5b79052dfd7d2f833"} Jun 09 11:59:51.502748 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.502376 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kb4zk" event={"ID":"ee5540ec-89e6-420a-8503-81497d997feb","Type":"ContainerStarted","Data":"4263d531698f7906818bac8527f7703967c53673a12029d3b5ca37436cce96d0"} Jun 09 11:59:51.522082 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.522036 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kb4zk" podStartSLOduration=3.604667113 podStartE2EDuration="4.522021388s" totalImagesPullingTime="838.951248ms" totalInitContainerRuntime="78.403027ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:51.521011354 +0000 UTC m=+305.440893863" watchObservedRunningTime="2026-06-09 11:59:51.522021388 +0000 UTC m=+305.441903877" Jun 09 11:59:51.556422 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.556395 2550 scope.go:117] "RemoveContainer" containerID="777682fa6b08ed5901c36a6a6cceaa156dd6004bc587c6a8babc50a1350f30ab" Jun 09 11:59:51.701473 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.701427 2550 patch_prober.go:28] interesting pod/image-registry-799f94d99b-c778j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:59:51.701651 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:51.701483 2550 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-799f94d99b-c778j" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:59:52.047445 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.047403 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-775d9d78d7-8kn27"] Jun 09 11:59:52.050495 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.050477 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.053132 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053113 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qqwlz\"" Jun 09 11:59:52.053301 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053282 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 11:59:52.053455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053430 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 11:59:52.053455 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053436 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-992ll455ehkm4\"" Jun 09 11:59:52.053635 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053510 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:59:52.053635 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.053500 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 11:59:52.062173 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.062149 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775d9d78d7-8kn27"] Jun 09 11:59:52.199049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199016 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-client-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199049 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199048 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-metrics-server-audit-profiles\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199097 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-tls\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199132 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-audit-log\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199163 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-client-certs\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.199282 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.199247 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d2vx\" (UniqueName: \"kubernetes.io/projected/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-kube-api-access-4d2vx\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300493 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300405 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300493 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300443 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-tls\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300493 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300460 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-audit-log\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300598 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-client-certs\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300652 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d2vx\" (UniqueName: \"kubernetes.io/projected/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-kube-api-access-4d2vx\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300745 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300723 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-client-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300910 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300749 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-metrics-server-audit-profiles\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.300910 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.300881 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-audit-log\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.301230 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.301206 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.301770 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.301746 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-metrics-server-audit-profiles\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.303001 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.302980 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-client-ca-bundle\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.303001 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.303003 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-tls\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.303202 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.303186 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-secret-metrics-server-client-certs\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.312290 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.312262 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d2vx\" (UniqueName: \"kubernetes.io/projected/55bfe390-4921-4cc3-98ff-9eb6cfda3aea-kube-api-access-4d2vx\") pod \"metrics-server-775d9d78d7-8kn27\" (UID: \"55bfe390-4921-4cc3-98ff-9eb6cfda3aea\") " pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.360028 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.359993 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 11:59:52.507962 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.507938 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 11:59:52.508327 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.508055 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" event={"ID":"5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d","Type":"ContainerStarted","Data":"00f67d0cd81ef1803d51e576c203a4417a579273decf7dcfa513e027005ff85c"} Jun 09 11:59:52.508513 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.508492 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:52.512945 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.512923 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" Jun 09 11:59:52.519433 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.519409 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775d9d78d7-8kn27"] Jun 09 11:59:52.522652 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:52.522625 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bfe390_4921_4cc3_98ff_9eb6cfda3aea.slice/crio-c6804081070935d51fc9cecad441ff530fcc64efd888d365198593cf0cc892d7 WatchSource:0}: Error finding container c6804081070935d51fc9cecad441ff530fcc64efd888d365198593cf0cc892d7: Status 404 returned error can't find the container with id c6804081070935d51fc9cecad441ff530fcc64efd888d365198593cf0cc892d7 Jun 09 11:59:52.526097 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:52.525998 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-jj9n8" podStartSLOduration=44.38500614 podStartE2EDuration="47.52598526s" totalImagesPullingTime="3.14097912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:52.525257861 +0000 UTC m=+306.445140370" watchObservedRunningTime="2026-06-09 11:59:52.52598526 +0000 UTC m=+306.445867835" Jun 09 11:59:53.413004 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.412972 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 11:59:53.512843 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.512810 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" event={"ID":"55bfe390-4921-4cc3-98ff-9eb6cfda3aea","Type":"ContainerStarted","Data":"c6804081070935d51fc9cecad441ff530fcc64efd888d365198593cf0cc892d7"} Jun 09 11:59:53.867234 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.867207 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:53.871965 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.871942 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.874499 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.874472 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 11:59:53.875876 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.875849 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 11:59:53.875984 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.875849 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 11:59:53.876298 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876232 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 11:59:53.876298 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876263 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 11:59:53.876438 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876263 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 11:59:53.876563 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876547 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 11:59:53.876563 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876563 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 11:59:53.876754 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876714 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fivti6p9k7f8\"" Jun 09 11:59:53.876837 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.876824 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gjz2v\"" Jun 09 11:59:53.877183 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.877163 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 11:59:53.877539 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.877520 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 11:59:53.877644 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.877584 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 11:59:53.877644 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.877632 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 11:59:53.877805 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.877704 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 11:59:53.881221 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.881181 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 11:59:53.901910 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.901878 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915385 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915429 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915454 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915487 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnbd\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915518 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915538 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915560 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915581 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915602 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915630 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915683 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915725 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915759 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915792 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915819 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.916166 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.917029 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915898 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.917029 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915921 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.917029 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915955 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:53.917029 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:53.915981 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016669 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016735 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016762 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016808 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016833 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016862 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016890 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.016938 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016921 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016948 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.016995 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.017037 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnbd\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.017073 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.017096 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.017491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.017121 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.018432 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.018083 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.018432 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.018181 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.018432 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.018320 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019356 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019328 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019466 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019386 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019466 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019419 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019579 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019485 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019579 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019506 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019579 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019529 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.019579 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.019569 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.020072 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.020046 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.020184 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.020079 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.020682 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.020652 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.020916 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.020897 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.021416 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.021143 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.022135 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.022091 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.023026 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.022990 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.023516 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.023489 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.023606 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.023590 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.024167 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.024111 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.024528 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.024506 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.024897 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.024872 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.025041 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.025022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.025105 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.025040 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.025758 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.025740 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnbd\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.026476 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.026459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.183487 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.183452 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:59:54.359507 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.359403 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:59:54.363073 ip-10-0-129-85 kubenswrapper[2550]: W0609 11:59:54.363046 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ee0b99_86c3_46aa_a8df_88f8eb53e89c.slice/crio-e230b0bb5e0db2d067ba42b7a12542c2f457378ac13c4099d731caf5d82a6715 WatchSource:0}: Error finding container e230b0bb5e0db2d067ba42b7a12542c2f457378ac13c4099d731caf5d82a6715: Status 404 returned error can't find the container with id e230b0bb5e0db2d067ba42b7a12542c2f457378ac13c4099d731caf5d82a6715 Jun 09 11:59:54.517491 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.517398 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"e230b0bb5e0db2d067ba42b7a12542c2f457378ac13c4099d731caf5d82a6715"} Jun 09 11:59:54.519001 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.518961 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" event={"ID":"55bfe390-4921-4cc3-98ff-9eb6cfda3aea","Type":"ContainerStarted","Data":"996be3374e93301fe92f3a97ddf9fe919508660fdc66b9763d190f1619efd7f9"} Jun 09 11:59:54.539583 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:54.539539 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" podStartSLOduration=1.241436218 podStartE2EDuration="2.539526309s" totalImagesPullingTime="1.298090091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:54.5391252 +0000 UTC m=+308.459007707" watchObservedRunningTime="2026-06-09 11:59:54.539526309 +0000 UTC m=+308.459408815" Jun 09 11:59:55.523086 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:55.523003 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 11:59:55.524532 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:55.524499 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38" exitCode=0 Jun 09 11:59:55.524659 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:55.524606 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38"} Jun 09 11:59:58.540452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:58.540359 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4"} Jun 09 11:59:58.540452 ip-10-0-129-85 kubenswrapper[2550]: I0609 11:59:58.540440 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77"} Jun 09 12:00:00.551242 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:00.551206 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0"} Jun 09 12:00:00.551609 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:00.551320 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d"} Jun 09 12:00:00.551609 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:00.551368 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d"} Jun 09 12:00:00.551609 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:00.551402 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerStarted","Data":"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351"} Jun 09 12:00:00.582437 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:00.582386 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.292568156 podStartE2EDuration="7.58237106s" totalImagesPullingTime="5.267535823s" totalInitContainerRuntime="22.267081ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:00.581830896 +0000 UTC m=+314.501713405" watchObservedRunningTime="2026-06-09 12:00:00.58237106 +0000 UTC m=+314.502253567" Jun 09 12:00:04.184281 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:04.184242 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:12.360775 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:12.360724 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 12:00:12.361250 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:12.360802 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 12:00:20.543856 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.543791 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-799f94d99b-c778j" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerName="registry" containerID="cri-o://93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34" gracePeriod=30 Jun 09 12:00:20.810324 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.810298 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 12:00:20.962280 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962248 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962302 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962322 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962346 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962373 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrgcl\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962451 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962737 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962490 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962737 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962518 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates\") pod \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\" (UID: \"74fdd365-bdb9-48e7-ad68-6706bcde6af5\") " Jun 09 12:00:20.962854 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.962780 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:20.963135 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.963104 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:20.964833 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.964792 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:20.965027 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.964992 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:20.965103 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.965043 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl" (OuterVolumeSpecName: "kube-api-access-vrgcl") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "kube-api-access-vrgcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:20.965103 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.965056 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:20.965247 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.965173 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:20.971511 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:20.971487 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74fdd365-bdb9-48e7-ad68-6706bcde6af5" (UID: "74fdd365-bdb9-48e7-ad68-6706bcde6af5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063898 2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-bound-sa-token\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063920 2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74fdd365-bdb9-48e7-ad68-6706bcde6af5-ca-trust-extracted\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063930 2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-certificates\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063939 2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-registry-tls\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063948 2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-image-registry-private-configuration\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063956 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74fdd365-bdb9-48e7-ad68-6706bcde6af5-trusted-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.063966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063964 2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74fdd365-bdb9-48e7-ad68-6706bcde6af5-installation-pull-secrets\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.064246 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.063973 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrgcl\" (UniqueName: \"kubernetes.io/projected/74fdd365-bdb9-48e7-ad68-6706bcde6af5-kube-api-access-vrgcl\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:00:21.627659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.627621 2550 generic.go:356] "Generic (PLEG): container finished" podID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerID="93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34" exitCode=0 Jun 09 12:00:21.627659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.627662 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799f94d99b-c778j" Jun 09 12:00:21.628146 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.627728 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f94d99b-c778j" event={"ID":"74fdd365-bdb9-48e7-ad68-6706bcde6af5","Type":"ContainerDied","Data":"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34"} Jun 09 12:00:21.628146 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.627781 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799f94d99b-c778j" event={"ID":"74fdd365-bdb9-48e7-ad68-6706bcde6af5","Type":"ContainerDied","Data":"5125722f6bb83fa7355c4f34a5aaa4906d9152826e49d224d6aee6615b16c79b"} Jun 09 12:00:21.628146 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.627804 2550 scope.go:117] "RemoveContainer" containerID="93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34" Jun 09 12:00:21.636649 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.636632 2550 scope.go:117] "RemoveContainer" containerID="93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34" Jun 09 12:00:21.636918 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:00:21.636898 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34\": container with ID starting with 93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34 not found: ID does not exist" containerID="93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34" Jun 09 12:00:21.636971 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.636927 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34"} err="failed to get container status \"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34\": rpc error: code = NotFound desc = could not find container \"93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34\": container with ID starting with 93b9141daee6c84c0315a4e407c02768708cef5e6bbd230ec0114f0144893c34 not found: ID does not exist" Jun 09 12:00:21.653896 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.653873 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 12:00:21.657779 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:21.657760 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-799f94d99b-c778j"] Jun 09 12:00:22.560950 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:22.560918 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" path="/var/lib/kubelet/pods/74fdd365-bdb9-48e7-ad68-6706bcde6af5/volumes" Jun 09 12:00:32.366184 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:32.366154 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 12:00:32.369746 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:32.369721 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-775d9d78d7-8kn27" Jun 09 12:00:36.682652 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:36.682618 2550 generic.go:356] "Generic (PLEG): container finished" podID="3459c5e3-75e5-4330-b655-ece1e1c03f2a" containerID="d7be1d0642177c7eb51c10d526a34e799d515be3b4ebddfed265b669e24f81bc" exitCode=0 Jun 09 12:00:36.683091 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:36.682715 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-cfv2j" event={"ID":"3459c5e3-75e5-4330-b655-ece1e1c03f2a","Type":"ContainerDied","Data":"d7be1d0642177c7eb51c10d526a34e799d515be3b4ebddfed265b669e24f81bc"} Jun 09 12:00:36.683091 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:36.683065 2550 scope.go:117] "RemoveContainer" containerID="d7be1d0642177c7eb51c10d526a34e799d515be3b4ebddfed265b669e24f81bc" Jun 09 12:00:37.690142 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:37.690109 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-cfv2j" event={"ID":"3459c5e3-75e5-4330-b655-ece1e1c03f2a","Type":"ContainerStarted","Data":"3ed75a343181a140ae407ab05c67166b69f9900e511908c86e4a1c4522824ee5"} Jun 09 12:00:40.702871 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:40.702831 2550 generic.go:356] "Generic (PLEG): container finished" podID="bafab310-40dd-42dc-aaa0-174d252ddd09" containerID="fdf37b1ff415bb07bead6f28186a2903a665a3cc13669a8bc2690b185bcd9152" exitCode=0 Jun 09 12:00:40.703249 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:40.702907 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" event={"ID":"bafab310-40dd-42dc-aaa0-174d252ddd09","Type":"ContainerDied","Data":"fdf37b1ff415bb07bead6f28186a2903a665a3cc13669a8bc2690b185bcd9152"} Jun 09 12:00:40.703249 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:40.703212 2550 scope.go:117] "RemoveContainer" containerID="fdf37b1ff415bb07bead6f28186a2903a665a3cc13669a8bc2690b185bcd9152" Jun 09 12:00:41.708315 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:41.708282 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-k9mvf" event={"ID":"bafab310-40dd-42dc-aaa0-174d252ddd09","Type":"ContainerStarted","Data":"4792ec25720e6df2c42f95802b8e75a8f33da0289d5416976317d1194efc83bb"} Jun 09 12:00:54.184065 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:54.184013 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:54.199569 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:54.199544 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:00:54.775202 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:00:54.775176 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:00.500656 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:00.500620 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 12:01:00.502896 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:00.502873 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb53e4e4-5938-46cd-bd99-90c67febaed3-metrics-certs\") pod \"network-metrics-daemon-zxl4m\" (UID: \"cb53e4e4-5938-46cd-bd99-90c67febaed3\") " pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 12:01:00.760389 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:00.760310 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzslx\"" Jun 09 12:01:00.768112 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:00.768092 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxl4m" Jun 09 12:01:00.903962 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:00.903943 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxl4m"] Jun 09 12:01:00.906737 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:01:00.906706 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb53e4e4_5938_46cd_bd99_90c67febaed3.slice/crio-7acdab8ec1648f77e1b5f0f4e22c68ee2b4e3167a9c45e5876776349c9351f5e WatchSource:0}: Error finding container 7acdab8ec1648f77e1b5f0f4e22c68ee2b4e3167a9c45e5876776349c9351f5e: Status 404 returned error can't find the container with id 7acdab8ec1648f77e1b5f0f4e22c68ee2b4e3167a9c45e5876776349c9351f5e Jun 09 12:01:01.788319 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:01.788283 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxl4m" event={"ID":"cb53e4e4-5938-46cd-bd99-90c67febaed3","Type":"ContainerStarted","Data":"7acdab8ec1648f77e1b5f0f4e22c68ee2b4e3167a9c45e5876776349c9351f5e"} Jun 09 12:01:02.793988 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:02.793952 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxl4m" event={"ID":"cb53e4e4-5938-46cd-bd99-90c67febaed3","Type":"ContainerStarted","Data":"c0218008cc708e4add01413eb0c6c4071bdbbc6a8be5d00d4d55ce83fdc814a6"} Jun 09 12:01:02.794454 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:02.794008 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxl4m" event={"ID":"cb53e4e4-5938-46cd-bd99-90c67febaed3","Type":"ContainerStarted","Data":"264d896fb5db2093a871ebc81c77c55f600c802f814e72103ac94082a2237281"} Jun 09 12:01:02.811306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:02.811256 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zxl4m" podStartSLOduration=375.6946288 podStartE2EDuration="6m16.81124175s" totalImagesPullingTime="1.11661295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:02.81050351 +0000 UTC m=+376.730386015" watchObservedRunningTime="2026-06-09 12:01:02.81124175 +0000 UTC m=+376.731124255" Jun 09 12:01:12.248608 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.248563 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:12.249211 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.249046 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="prometheus" containerID="cri-o://d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77" gracePeriod=600 Jun 09 12:01:12.249211 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.249105 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="thanos-sidecar" containerID="cri-o://8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351" gracePeriod=600 Jun 09 12:01:12.249327 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.249214 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="config-reloader" containerID="cri-o://8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4" gracePeriod=600 Jun 09 12:01:12.249327 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.249211 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-web" containerID="cri-o://d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d" gracePeriod=600 Jun 09 12:01:12.249421 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.249339 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0" gracePeriod=600 Jun 09 12:01:12.250452 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.250350 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy" containerID="cri-o://fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d" gracePeriod=600 Jun 09 12:01:12.839614 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839579 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0" exitCode=0 Jun 09 12:01:12.839614 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839604 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d" exitCode=0 Jun 09 12:01:12.839614 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839610 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351" exitCode=0 Jun 09 12:01:12.839614 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839617 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4" exitCode=0 Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839625 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77" exitCode=0 Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839648 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0"} Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839734 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d"} Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839762 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351"} Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839786 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4"} Jun 09 12:01:12.839909 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:12.839808 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77"} Jun 09 12:01:13.505358 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.505335 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:13.611434 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611348 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611434 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611391 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611434 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611423 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611450 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611490 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611514 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611547 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611571 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611612 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611643 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.611719 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611667 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611917 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611750 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.611995 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612026 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqnbd\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612070 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612110 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612108 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612385 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612152 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612385 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612179 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612385 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612239 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612385 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612285 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls\") pod \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\" (UID: \"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c\") " Jun 09 12:01:13.612577 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612564 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.613039 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612907 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:13.613039 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612936 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.613039 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.612946 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.614017 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.613719 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.615142 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.615113 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.615259 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.615236 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out" (OuterVolumeSpecName: "config-out") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:01:13.615328 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.615265 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.615328 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.615318 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.615807 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.615778 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:13.616744 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.616680 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617074 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617016 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617179 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617145 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617380 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617346 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617613 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617585 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617613 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617601 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617760 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617628 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config" (OuterVolumeSpecName: "config") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.617955 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.617926 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:13.618098 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.618077 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd" (OuterVolumeSpecName: "kube-api-access-dqnbd") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "kube-api-access-dqnbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:13.626024 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.626001 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config" (OuterVolumeSpecName: "web-config") pod "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" (UID: "c5ee0b99-86c3-46aa-a8df-88f8eb53e89c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:13.713092 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713058 2550 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713092 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713086 2550 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-grpc-tls\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713092 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713096 2550 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-web-config\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713104 2550 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-config-out\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713111 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-db\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713121 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713131 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713141 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713149 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-metrics-client-ca\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713158 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713166 2550 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713174 2550 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-kube-rbac-proxy\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713183 2550 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713192 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713200 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqnbd\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-kube-api-access-dqnbd\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713208 2550 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713217 2550 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-tls-assets\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713225 2550 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.713306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.713235 2550 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c-secret-metrics-client-certs\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:01:13.846486 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.846455 2550 generic.go:356] "Generic (PLEG): container finished" podID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerID="d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d" exitCode=0 Jun 09 12:01:13.846640 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.846515 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d"} Jun 09 12:01:13.846640 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.846529 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:13.846640 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.846582 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5ee0b99-86c3-46aa-a8df-88f8eb53e89c","Type":"ContainerDied","Data":"e230b0bb5e0db2d067ba42b7a12542c2f457378ac13c4099d731caf5d82a6715"} Jun 09 12:01:13.846640 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.846616 2550 scope.go:117] "RemoveContainer" containerID="00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0" Jun 09 12:01:13.854538 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.854519 2550 scope.go:117] "RemoveContainer" containerID="fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d" Jun 09 12:01:13.861913 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.861896 2550 scope.go:117] "RemoveContainer" containerID="d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d" Jun 09 12:01:13.868176 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.868159 2550 scope.go:117] "RemoveContainer" containerID="8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351" Jun 09 12:01:13.871242 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.871220 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:13.875128 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.875108 2550 scope.go:117] "RemoveContainer" containerID="8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4" Jun 09 12:01:13.879108 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.879091 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:13.882578 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.882564 2550 scope.go:117] "RemoveContainer" containerID="d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77" Jun 09 12:01:13.889354 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.889338 2550 scope.go:117] "RemoveContainer" containerID="fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38" Jun 09 12:01:13.895529 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.895516 2550 scope.go:117] "RemoveContainer" containerID="00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0" Jun 09 12:01:13.895808 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.895785 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0\": container with ID starting with 00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0 not found: ID does not exist" containerID="00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0" Jun 09 12:01:13.895897 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.895816 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0"} err="failed to get container status \"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0\": rpc error: code = NotFound desc = could not find container \"00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0\": container with ID starting with 00c4eb8b445df693318587fe371b4bc8c130f2dc169913ea120f6977fb530bd0 not found: ID does not exist" Jun 09 12:01:13.895897 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.895838 2550 scope.go:117] "RemoveContainer" containerID="fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d" Jun 09 12:01:13.896099 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.896082 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d\": container with ID starting with fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d not found: ID does not exist" containerID="fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d" Jun 09 12:01:13.896148 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896105 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d"} err="failed to get container status \"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d\": rpc error: code = NotFound desc = could not find container \"fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d\": container with ID starting with fb24d7bdb7e207350a6b5979debebc0457797bff840af45d39e3bba0f9cbae1d not found: ID does not exist" Jun 09 12:01:13.896148 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896121 2550 scope.go:117] "RemoveContainer" containerID="d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d" Jun 09 12:01:13.896347 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.896329 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d\": container with ID starting with d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d not found: ID does not exist" containerID="d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d" Jun 09 12:01:13.896425 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896350 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d"} err="failed to get container status \"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d\": rpc error: code = NotFound desc = could not find container \"d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d\": container with ID starting with d425574b0a1922216f6f8922b553227c2d04b0195f70f5ada69f2d9deb45945d not found: ID does not exist" Jun 09 12:01:13.896425 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896365 2550 scope.go:117] "RemoveContainer" containerID="8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351" Jun 09 12:01:13.896637 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.896619 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351\": container with ID starting with 8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351 not found: ID does not exist" containerID="8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351" Jun 09 12:01:13.896861 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896643 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351"} err="failed to get container status \"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351\": rpc error: code = NotFound desc = could not find container \"8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351\": container with ID starting with 8f1082a7a979211eb4820c493145211f9105a39c81457afe6751b4cfd3459351 not found: ID does not exist" Jun 09 12:01:13.896861 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896657 2550 scope.go:117] "RemoveContainer" containerID="8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4" Jun 09 12:01:13.896991 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.896929 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4\": container with ID starting with 8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4 not found: ID does not exist" containerID="8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4" Jun 09 12:01:13.896991 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896952 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4"} err="failed to get container status \"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4\": rpc error: code = NotFound desc = could not find container \"8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4\": container with ID starting with 8e60e01c0629255bcfd410ac8c79c474ed669f8a1c149b1aac495f9dacbb0bf4 not found: ID does not exist" Jun 09 12:01:13.896991 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.896971 2550 scope.go:117] "RemoveContainer" containerID="d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77" Jun 09 12:01:13.897257 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.897237 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77\": container with ID starting with d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77 not found: ID does not exist" containerID="d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77" Jun 09 12:01:13.897307 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.897263 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77"} err="failed to get container status \"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77\": rpc error: code = NotFound desc = could not find container \"d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77\": container with ID starting with d46e82fa105ebad65ade0064ad1dd32de3a7196b46f2bf0362d77cf7962d5d77 not found: ID does not exist" Jun 09 12:01:13.897307 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.897279 2550 scope.go:117] "RemoveContainer" containerID="fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38" Jun 09 12:01:13.897508 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:01:13.897488 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38\": container with ID starting with fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38 not found: ID does not exist" containerID="fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38" Jun 09 12:01:13.897549 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.897513 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38"} err="failed to get container status \"fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38\": rpc error: code = NotFound desc = could not find container \"fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38\": container with ID starting with fa0df6ca42166b05dc6866cd898c4f554f53de84bd37a606bdc9534ca6b93f38 not found: ID does not exist" Jun 09 12:01:13.907661 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907640 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:13.907931 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907917 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="config-reloader" Jun 09 12:01:13.907931 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907932 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="config-reloader" Jun 09 12:01:13.907931 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907943 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="thanos-sidecar" Jun 09 12:01:13.907931 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907948 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="thanos-sidecar" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907955 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-web" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907960 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-web" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907971 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907976 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907983 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerName="registry" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907988 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerName="registry" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.907998 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="init-config-reloader" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908004 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="init-config-reloader" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908010 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="prometheus" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908015 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="prometheus" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908026 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908032 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908072 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-thanos" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908079 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908086 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="config-reloader" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908092 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="74fdd365-bdb9-48e7-ad68-6706bcde6af5" containerName="registry" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908098 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="kube-rbac-proxy-web" Jun 09 12:01:13.908096 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908104 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="prometheus" Jun 09 12:01:13.908659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.908110 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" containerName="thanos-sidecar" Jun 09 12:01:13.914653 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.914631 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:13.917800 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.917757 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 12:01:13.917800 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.917788 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 12:01:13.918118 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918067 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 12:01:13.918192 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918145 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 12:01:13.918290 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918189 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 12:01:13.918290 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918191 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 12:01:13.918290 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918287 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 12:01:13.918544 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918527 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 12:01:13.918659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918532 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 12:01:13.918659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918634 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 12:01:13.918659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918634 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gjz2v\"" Jun 09 12:01:13.918872 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918792 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 12:01:13.918928 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.918913 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5fivti6p9k7f8\"" Jun 09 12:01:13.919032 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.919013 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 12:01:13.922463 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.922425 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 12:01:13.925313 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.925296 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 12:01:13.931855 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:13.931831 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:14.016043 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016012 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016043 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016042 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxv2\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-kube-api-access-mfxv2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016062 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016110 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016176 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016199 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016217 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016239 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016257 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016272 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-web-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016289 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016304 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016321 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016390 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016373 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016423 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016443 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016458 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016481 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-config-out\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016527 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.016599 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.016544 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117327 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117242 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117327 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117279 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117327 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117301 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117596 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117596 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117540 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117596 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117558 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117596 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117576 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-web-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117831 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117719 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117831 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117769 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117831 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117794 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117833 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117866 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117881 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117902 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117931 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-config-out\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.117981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117961 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.117988 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118049 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118073 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxv2\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-kube-api-access-mfxv2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118107 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118196 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118508 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118267 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118508 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118288 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.118611 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118517 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.119001 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.118973 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.120266 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.120234 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.120466 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.120441 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.121517 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.121125 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.121517 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.121186 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.121517 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.121459 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.121769 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.121590 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.122482 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.122269 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.122482 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.122425 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61fb689d-84db-4e49-a936-9c1be16f046b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.122626 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.122499 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.122626 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.122569 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.122721 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.122622 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61fb689d-84db-4e49-a936-9c1be16f046b-config-out\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.123080 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.123059 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.123455 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.123436 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-web-config\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.123575 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.123558 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61fb689d-84db-4e49-a936-9c1be16f046b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.128648 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.128631 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxv2\" (UniqueName: \"kubernetes.io/projected/61fb689d-84db-4e49-a936-9c1be16f046b-kube-api-access-mfxv2\") pod \"prometheus-k8s-0\" (UID: \"61fb689d-84db-4e49-a936-9c1be16f046b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.225490 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.225458 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:01:14.361747 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.361721 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 12:01:14.364230 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:01:14.364204 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fb689d_84db_4e49_a936_9c1be16f046b.slice/crio-be70f6d097f1a35f9fc9bcb80ef30b66f16c6290b1e3e0eea2fc1a76602e103a WatchSource:0}: Error finding container be70f6d097f1a35f9fc9bcb80ef30b66f16c6290b1e3e0eea2fc1a76602e103a: Status 404 returned error can't find the container with id be70f6d097f1a35f9fc9bcb80ef30b66f16c6290b1e3e0eea2fc1a76602e103a Jun 09 12:01:14.560860 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.560830 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ee0b99-86c3-46aa-a8df-88f8eb53e89c" path="/var/lib/kubelet/pods/c5ee0b99-86c3-46aa-a8df-88f8eb53e89c/volumes" Jun 09 12:01:14.853549 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.853514 2550 generic.go:356] "Generic (PLEG): container finished" podID="61fb689d-84db-4e49-a936-9c1be16f046b" containerID="05aa7d25b3bfeaf5d08b6896239565e3a79fcfc71451b2e8d2236a308d4f230e" exitCode=0 Jun 09 12:01:14.853751 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.853576 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerDied","Data":"05aa7d25b3bfeaf5d08b6896239565e3a79fcfc71451b2e8d2236a308d4f230e"} Jun 09 12:01:14.853751 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:14.853631 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"be70f6d097f1a35f9fc9bcb80ef30b66f16c6290b1e3e0eea2fc1a76602e103a"} Jun 09 12:01:15.860999 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.860962 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"661e844752dba58a2f46a6545b2a2a8d7d314dced8620e8718a9d2df29d6636d"} Jun 09 12:01:15.861427 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.861056 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"8d56574e7e8da4ba8e2160ae977f0eeb5b802356138699a2f1b9870aefb6d863"} Jun 09 12:01:15.861427 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.861081 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"921ac8afd80385eb78a07f254eeae4ccb3dbf12acae4dc9b5d23c10d83fd9923"} Jun 09 12:01:15.861427 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.861105 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"788df6e4d6c77e2faca9aa6f4c75f0dfe22c979c166bdc6e6191de3acea529fa"} Jun 09 12:01:15.861427 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.861128 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"1fbf74292afc1d2088a8a822c6e20f1c2870253c99894297b11ddc05bf1cac2a"} Jun 09 12:01:15.861427 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.861149 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61fb689d-84db-4e49-a936-9c1be16f046b","Type":"ContainerStarted","Data":"4881491f08f3cbbbbd023a82b1cba6b55fbfd9184d9a91d119c34d82d9c4849a"} Jun 09 12:01:15.891512 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:15.891454 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8730374960000002 podStartE2EDuration="2.891433717s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.396221ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:15.888881239 +0000 UTC m=+389.808763774" watchObservedRunningTime="2026-06-09 12:01:15.891433717 +0000 UTC m=+389.811316225" Jun 09 12:01:19.225790 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:01:19.225735 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:02:14.225983 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:02:14.225889 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:02:14.241158 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:02:14.241135 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:02:15.102555 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:02:15.102526 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 12:04:03.632797 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.632761 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz"] Jun 09 12:04:03.635999 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.635982 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.639617 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:03.639582 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 09 12:04:03.640188 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:03.640163 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"cert-manager-cainjector-5d99449ffd-4fcvz\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="708b7fa0-d5ae-420a-b4d2-0131931aa05d" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.640284 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:03.640243 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 09 12:04:03.640372 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:03.640351 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cert-manager-cainjector-dockercfg-pktbq\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pktbq\"" type="*v1.Secret" Jun 09 12:04:03.663386 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.663357 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz"] Jun 09 12:04:03.782714 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.782673 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.782874 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.782724 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zf5z\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.883780 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.883677 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.883780 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.883738 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zf5z\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:03.898707 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:03.898668 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:04.697354 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:04.697322 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pktbq\"" Jun 09 12:04:04.897490 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:04.897461 2550 projected.go:291] Couldn't get configMap cert-manager/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 09 12:04:05.066487 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:05.066411 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:04:05.206640 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:05.206609 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:04:05.207662 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:05.207645 2550 projected.go:196] Error preparing data for projected volume kube-api-access-8zf5z for pod cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz: failed to sync configmap cache: timed out waiting for the condition Jun 09 12:04:05.207742 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:04:05.207732 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z podName:708b7fa0-d5ae-420a-b4d2-0131931aa05d nodeName:}" failed. No retries permitted until 2026-06-09 12:04:05.707716438 +0000 UTC m=+559.627598921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8zf5z" (UniqueName: "kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z") pod "cert-manager-cainjector-5d99449ffd-4fcvz" (UID: "708b7fa0-d5ae-420a-b4d2-0131931aa05d") : failed to sync configmap cache: timed out waiting for the condition Jun 09 12:04:05.797066 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:05.797027 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zf5z\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:05.799581 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:05.799558 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zf5z\" (UniqueName: \"kubernetes.io/projected/708b7fa0-d5ae-420a-b4d2-0131931aa05d-kube-api-access-8zf5z\") pod \"cert-manager-cainjector-5d99449ffd-4fcvz\" (UID: \"708b7fa0-d5ae-420a-b4d2-0131931aa05d\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:06.057681 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:06.057592 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" Jun 09 12:04:06.187760 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:06.187670 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz"] Jun 09 12:04:06.190567 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:04:06.190541 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod708b7fa0_d5ae_420a_b4d2_0131931aa05d.slice/crio-b0d13345bdc7d3772a12def6518a1a35f22e87326d01ebbaf558f4fe9e3a5dae WatchSource:0}: Error finding container b0d13345bdc7d3772a12def6518a1a35f22e87326d01ebbaf558f4fe9e3a5dae: Status 404 returned error can't find the container with id b0d13345bdc7d3772a12def6518a1a35f22e87326d01ebbaf558f4fe9e3a5dae Jun 09 12:04:06.496561 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:06.496524 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" event={"ID":"708b7fa0-d5ae-420a-b4d2-0131931aa05d","Type":"ContainerStarted","Data":"b0d13345bdc7d3772a12def6518a1a35f22e87326d01ebbaf558f4fe9e3a5dae"} Jun 09 12:04:09.512347 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:09.512306 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" event={"ID":"708b7fa0-d5ae-420a-b4d2-0131931aa05d","Type":"ContainerStarted","Data":"95656b95e503c69cef2fac9b2d2ef39e1ff442e1e6294db24ae75b5b6f10357f"} Jun 09 12:04:39.285306 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.285251 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-4fcvz" podStartSLOduration=33.368670761 podStartE2EDuration="36.285233622s" totalImagesPullingTime="2.916562861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:09.546152948 +0000 UTC m=+563.466035455" watchObservedRunningTime="2026-06-09 12:04:39.285233622 +0000 UTC m=+593.205116133" Jun 09 12:04:39.285986 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.285970 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84"] Jun 09 12:04:39.289115 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.289095 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295547 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295564 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295598 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-crgsk\"" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295675 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295566 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:04:39.295977 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.295841 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 12:04:39.308033 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.308001 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84"] Jun 09 12:04:39.373224 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.373190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.373376 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.373251 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-manager-config\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.373376 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.373307 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcrfs\" (UniqueName: \"kubernetes.io/projected/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-kube-api-access-pcrfs\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.373376 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.373325 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-metrics-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.474610 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.474575 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-manager-config\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.474798 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.474631 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcrfs\" (UniqueName: \"kubernetes.io/projected/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-kube-api-access-pcrfs\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.474798 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.474649 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-metrics-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.474798 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.474672 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.475425 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.475389 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-manager-config\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.477174 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.477152 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.477278 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.477242 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-metrics-cert\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.485891 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.485871 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcrfs\" (UniqueName: \"kubernetes.io/projected/cd10e9cb-ddd7-4624-b9fd-8839699a3ecc-kube-api-access-pcrfs\") pod \"lws-controller-manager-7c49b6b8b6-7gk84\" (UID: \"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc\") " pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.598877 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.598803 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:39.727253 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:39.727227 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84"] Jun 09 12:04:39.729395 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:04:39.729366 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd10e9cb_ddd7_4624_b9fd_8839699a3ecc.slice/crio-bfa963a0b334972321e4234e47919b2e25680bc0c9c2d7c4b27cc01896337748 WatchSource:0}: Error finding container bfa963a0b334972321e4234e47919b2e25680bc0c9c2d7c4b27cc01896337748: Status 404 returned error can't find the container with id bfa963a0b334972321e4234e47919b2e25680bc0c9c2d7c4b27cc01896337748 Jun 09 12:04:40.630342 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:40.630302 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" event={"ID":"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc","Type":"ContainerStarted","Data":"bfa963a0b334972321e4234e47919b2e25680bc0c9c2d7c4b27cc01896337748"} Jun 09 12:04:42.640360 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:42.640277 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" event={"ID":"cd10e9cb-ddd7-4624-b9fd-8839699a3ecc","Type":"ContainerStarted","Data":"272c2c608f3d4d141f044af513f9b8aeff1159ee8a2f16040e926aa11a05d1c0"} Jun 09 12:04:42.640728 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:42.640371 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:42.657112 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:42.657064 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" podStartSLOduration=1.069162693 podStartE2EDuration="3.657048429s" totalImagesPullingTime="2.587885736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:42.65688256 +0000 UTC m=+596.576765066" watchObservedRunningTime="2026-06-09 12:04:42.657048429 +0000 UTC m=+596.576930936" Jun 09 12:04:46.532146 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:46.532105 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 12:04:46.532670 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:46.532318 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 12:04:48.078077 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.078044 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l"] Jun 09 12:04:48.081321 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.081305 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.083966 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.083945 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:04:48.088357 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.088190 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:04:48.088357 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.088194 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:04:48.088578 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.088560 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:04:48.088828 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.088813 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w9q64\"" Jun 09 12:04:48.152927 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.152892 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.152927 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.152929 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5dl\" (UniqueName: \"kubernetes.io/projected/e58f6cac-0898-4f34-8773-37c7c6552716-kube-api-access-2g5dl\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.153130 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.152966 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.153130 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.153008 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.153130 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.153077 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.161455 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.161425 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l"] Jun 09 12:04:48.254029 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.253993 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.254029 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.254033 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.254291 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.254053 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.254291 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.254129 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.254291 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.254154 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5dl\" (UniqueName: \"kubernetes.io/projected/e58f6cac-0898-4f34-8773-37c7c6552716-kube-api-access-2g5dl\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.254560 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.254530 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.256370 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.256349 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e58f6cac-0898-4f34-8773-37c7c6552716-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.256595 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.256573 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.256660 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.256573 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e58f6cac-0898-4f34-8773-37c7c6552716-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.270794 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.270769 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5dl\" (UniqueName: \"kubernetes.io/projected/e58f6cac-0898-4f34-8773-37c7c6552716-kube-api-access-2g5dl\") pod \"opendatahub-operator-controller-manager-656cd88b4c-hf54l\" (UID: \"e58f6cac-0898-4f34-8773-37c7c6552716\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.391763 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.391651 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:48.543166 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.543139 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l"] Jun 09 12:04:48.544865 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:04:48.544839 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58f6cac_0898_4f34_8773_37c7c6552716.slice/crio-d0f65d7fcc7e320ead6d5f31167ad067a919b9c19178f1ceb81b8d825ee6fa82 WatchSource:0}: Error finding container d0f65d7fcc7e320ead6d5f31167ad067a919b9c19178f1ceb81b8d825ee6fa82: Status 404 returned error can't find the container with id d0f65d7fcc7e320ead6d5f31167ad067a919b9c19178f1ceb81b8d825ee6fa82 Jun 09 12:04:48.667349 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:48.667264 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" event={"ID":"e58f6cac-0898-4f34-8773-37c7c6552716","Type":"ContainerStarted","Data":"d0f65d7fcc7e320ead6d5f31167ad067a919b9c19178f1ceb81b8d825ee6fa82"} Jun 09 12:04:51.682520 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:51.682427 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" event={"ID":"e58f6cac-0898-4f34-8773-37c7c6552716","Type":"ContainerStarted","Data":"635102fa504adb7bf792a908017c9242bd255395e0c25e8056f7a4e90e4d69c0"} Jun 09 12:04:52.688279 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:52.688244 2550 generic.go:356] "Generic (PLEG): container finished" podID="e58f6cac-0898-4f34-8773-37c7c6552716" containerID="635102fa504adb7bf792a908017c9242bd255395e0c25e8056f7a4e90e4d69c0" exitCode=0 Jun 09 12:04:52.688672 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:52.688285 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" event={"ID":"e58f6cac-0898-4f34-8773-37c7c6552716","Type":"ContainerDied","Data":"635102fa504adb7bf792a908017c9242bd255395e0c25e8056f7a4e90e4d69c0"} Jun 09 12:04:52.688809 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:52.688791 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:04:53.647431 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:53.647398 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c49b6b8b6-7gk84" Jun 09 12:04:53.696420 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:53.696367 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" event={"ID":"e58f6cac-0898-4f34-8773-37c7c6552716","Type":"ContainerStarted","Data":"c090b12c80e1aa931df0fcdb0124779acb2f406bfb99af0ffeb515ed6e9caa98"} Jun 09 12:04:53.696833 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:53.696511 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:04:53.797011 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:04:53.796960 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" podStartSLOduration=1.673714658 podStartE2EDuration="5.796943415s" totalImagesPullingTime="3.056454083s" totalInitContainerRuntime="1.066774674s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:53.782262786 +0000 UTC m=+607.702145293" watchObservedRunningTime="2026-06-09 12:04:53.796943415 +0000 UTC m=+607.716825921" Jun 09 12:05:04.702748 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:04.702715 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-hf54l" Jun 09 12:05:12.873967 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.873879 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw"] Jun 09 12:05:12.882760 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.882728 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:12.895680 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.895627 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7lqcw\"" Jun 09 12:05:12.896471 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.896453 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:05:12.896635 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.896619 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:05:12.906384 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.906354 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw"] Jun 09 12:05:12.972841 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.972809 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/957ff429-d295-4ecf-b4f3-24d8806161a6-tmp\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:12.972841 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.972843 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fztwg\" (UniqueName: \"kubernetes.io/projected/957ff429-d295-4ecf-b4f3-24d8806161a6-kube-api-access-fztwg\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:12.973067 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:12.972876 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/957ff429-d295-4ecf-b4f3-24d8806161a6-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.073847 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.073815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/957ff429-d295-4ecf-b4f3-24d8806161a6-tmp\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.073847 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.073851 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztwg\" (UniqueName: \"kubernetes.io/projected/957ff429-d295-4ecf-b4f3-24d8806161a6-kube-api-access-fztwg\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.074049 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.073881 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/957ff429-d295-4ecf-b4f3-24d8806161a6-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.076219 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.076188 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/957ff429-d295-4ecf-b4f3-24d8806161a6-tmp\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.076379 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.076363 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/957ff429-d295-4ecf-b4f3-24d8806161a6-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.097889 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.097854 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztwg\" (UniqueName: \"kubernetes.io/projected/957ff429-d295-4ecf-b4f3-24d8806161a6-kube-api-access-fztwg\") pod \"kube-auth-proxy-68d7c54df5-prfkw\" (UID: \"957ff429-d295-4ecf-b4f3-24d8806161a6\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.194260 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.194228 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" Jun 09 12:05:13.348213 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.348186 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw"] Jun 09 12:05:13.349018 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:05:13.348981 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957ff429_d295_4ecf_b4f3_24d8806161a6.slice/crio-2eaa0e124112b16f346fd13ee78db8beab5efc34983328aaee3f0c367da55e99 WatchSource:0}: Error finding container 2eaa0e124112b16f346fd13ee78db8beab5efc34983328aaee3f0c367da55e99: Status 404 returned error can't find the container with id 2eaa0e124112b16f346fd13ee78db8beab5efc34983328aaee3f0c367da55e99 Jun 09 12:05:13.784434 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:13.784394 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" event={"ID":"957ff429-d295-4ecf-b4f3-24d8806161a6","Type":"ContainerStarted","Data":"2eaa0e124112b16f346fd13ee78db8beab5efc34983328aaee3f0c367da55e99"} Jun 09 12:05:16.799079 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:16.799042 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" event={"ID":"957ff429-d295-4ecf-b4f3-24d8806161a6","Type":"ContainerStarted","Data":"4aed5a176448a7c14699c2bfdec66d29980047880f860875f3b11b49128936dd"} Jun 09 12:05:16.848857 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:05:16.848803 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-prfkw" podStartSLOduration=2.273416717 podStartE2EDuration="4.848789051s" totalImagesPullingTime="2.575372334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:16.848658307 +0000 UTC m=+630.768540815" watchObservedRunningTime="2026-06-09 12:05:16.848789051 +0000 UTC m=+630.768671556" Jun 09 12:06:44.239554 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.239476 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w"] Jun 09 12:06:44.242985 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.242955 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:44.247851 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.247811 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:44.248005 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.247983 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t7nkk\"" Jun 09 12:06:44.248950 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.248929 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:44.275025 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.274976 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggxc\" (UniqueName: \"kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc\") pod \"limitador-operator-controller-manager-859d7b78bd-2d84w\" (UID: \"a2797f16-a10f-4e26-be32-537e06887f6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:44.278730 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.278684 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w"] Jun 09 12:06:44.375413 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.375374 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggxc\" (UniqueName: \"kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc\") pod \"limitador-operator-controller-manager-859d7b78bd-2d84w\" (UID: \"a2797f16-a10f-4e26-be32-537e06887f6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:44.392520 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.392483 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggxc\" (UniqueName: \"kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc\") pod \"limitador-operator-controller-manager-859d7b78bd-2d84w\" (UID: \"a2797f16-a10f-4e26-be32-537e06887f6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:44.554361 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.554264 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:44.694811 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:44.694777 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w"] Jun 09 12:06:44.700893 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:06:44.700863 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2797f16_a10f_4e26_be32_537e06887f6d.slice/crio-41ac58dcd801e9a8167b252976d7657da6c1484a678a580168e919989c4310f2 WatchSource:0}: Error finding container 41ac58dcd801e9a8167b252976d7657da6c1484a678a580168e919989c4310f2: Status 404 returned error can't find the container with id 41ac58dcd801e9a8167b252976d7657da6c1484a678a580168e919989c4310f2 Jun 09 12:06:45.170775 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:45.170742 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" event={"ID":"a2797f16-a10f-4e26-be32-537e06887f6d","Type":"ContainerStarted","Data":"41ac58dcd801e9a8167b252976d7657da6c1484a678a580168e919989c4310f2"} Jun 09 12:06:47.182808 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:47.182736 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" event={"ID":"a2797f16-a10f-4e26-be32-537e06887f6d","Type":"ContainerStarted","Data":"e424c0d48470ad87041044b357b7bfba544ca5d434c480558e416a18d525e4c2"} Jun 09 12:06:47.183311 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:47.182873 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:06:47.219311 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:47.219255 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" podStartSLOduration=1.641525311 podStartE2EDuration="3.219238731s" totalImagesPullingTime="1.57771342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:47.217361229 +0000 UTC m=+721.137243735" watchObservedRunningTime="2026-06-09 12:06:47.219238731 +0000 UTC m=+721.139121294" Jun 09 12:06:58.188808 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:06:58.188773 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:01.087611 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.087577 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w"] Jun 09 12:07:01.088201 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.087822 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" containerName="manager" containerID="cri-o://e424c0d48470ad87041044b357b7bfba544ca5d434c480558e416a18d525e4c2" gracePeriod=2 Jun 09 12:07:01.115756 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.115709 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w"] Jun 09 12:07:01.132810 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:01.132772 2550 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a2797f16-a10f-4e26-be32-537e06887f6d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-2d84w\": pods \"limitador-operator-controller-manager-859d7b78bd-2d84w\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:01.145129 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.145093 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp"] Jun 09 12:07:01.145453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.145438 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" containerName="manager" Jun 09 12:07:01.145453 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.145452 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" containerName="manager" Jun 09 12:07:01.145592 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.145508 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" containerName="manager" Jun 09 12:07:01.148677 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.148653 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:01.188418 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.188386 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp"] Jun 09 12:07:01.214422 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.214384 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxcxg\" (UniqueName: \"kubernetes.io/projected/2ffe28ab-071a-47ef-b748-412388db1aa4-kube-api-access-sxcxg\") pod \"limitador-operator-controller-manager-859d7b78bd-l65tp\" (UID: \"2ffe28ab-071a-47ef-b748-412388db1aa4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:01.240114 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:01.240076 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d84w\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:01.244058 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.244027 2550 generic.go:356] "Generic (PLEG): container finished" podID="a2797f16-a10f-4e26-be32-537e06887f6d" containerID="e424c0d48470ad87041044b357b7bfba544ca5d434c480558e416a18d525e4c2" exitCode=0 Jun 09 12:07:01.315760 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.315734 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxcxg\" (UniqueName: \"kubernetes.io/projected/2ffe28ab-071a-47ef-b748-412388db1aa4-kube-api-access-sxcxg\") pod \"limitador-operator-controller-manager-859d7b78bd-l65tp\" (UID: \"2ffe28ab-071a-47ef-b748-412388db1aa4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:01.333649 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.333613 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxcxg\" (UniqueName: \"kubernetes.io/projected/2ffe28ab-071a-47ef-b748-412388db1aa4-kube-api-access-sxcxg\") pod \"limitador-operator-controller-manager-859d7b78bd-l65tp\" (UID: \"2ffe28ab-071a-47ef-b748-412388db1aa4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:01.333781 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.333753 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:01.336132 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:01.336108 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d84w\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:01.416578 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.416484 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ggxc\" (UniqueName: \"kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc\") pod \"a2797f16-a10f-4e26-be32-537e06887f6d\" (UID: \"a2797f16-a10f-4e26-be32-537e06887f6d\") " Jun 09 12:07:01.418656 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.418625 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc" (OuterVolumeSpecName: "kube-api-access-8ggxc") pod "a2797f16-a10f-4e26-be32-537e06887f6d" (UID: "a2797f16-a10f-4e26-be32-537e06887f6d"). InnerVolumeSpecName "kube-api-access-8ggxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:07:01.470073 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.470036 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:01.517642 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.517607 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ggxc\" (UniqueName: \"kubernetes.io/projected/a2797f16-a10f-4e26-be32-537e06887f6d-kube-api-access-8ggxc\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:07:01.620483 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:01.620451 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp"] Jun 09 12:07:01.623543 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:07:01.623515 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffe28ab_071a_47ef_b748_412388db1aa4.slice/crio-1b9db875c72dc930db1fa851ec73ee37f2069b766b4cd46000f9085bf90caa31 WatchSource:0}: Error finding container 1b9db875c72dc930db1fa851ec73ee37f2069b766b4cd46000f9085bf90caa31: Status 404 returned error can't find the container with id 1b9db875c72dc930db1fa851ec73ee37f2069b766b4cd46000f9085bf90caa31 Jun 09 12:07:02.249981 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.249951 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" event={"ID":"2ffe28ab-071a-47ef-b748-412388db1aa4","Type":"ContainerStarted","Data":"f7b6ba4c23cbce8f2c482866c235092f6c1567ce64486fdf2110e0ac87824f08"} Jun 09 12:07:02.250416 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.249999 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" event={"ID":"2ffe28ab-071a-47ef-b748-412388db1aa4","Type":"ContainerStarted","Data":"1b9db875c72dc930db1fa851ec73ee37f2069b766b4cd46000f9085bf90caa31"} Jun 09 12:07:02.250416 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.250059 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:02.251338 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.251324 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:02.251424 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.251321 2550 scope.go:117] "RemoveContainer" containerID="e424c0d48470ad87041044b357b7bfba544ca5d434c480558e416a18d525e4c2" Jun 09 12:07:02.252610 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:02.252435 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d84w\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:02.293171 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:02.293128 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2d84w\" is forbidden: User \"system:node:ip-10-0-129-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-85.ec2.internal' and this object" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2d84w" Jun 09 12:07:02.295916 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.295870 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" podStartSLOduration=1.2958539789999999 podStartE2EDuration="1.295853979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:02.290893169 +0000 UTC m=+736.210775676" watchObservedRunningTime="2026-06-09 12:07:02.295853979 +0000 UTC m=+736.215736485" Jun 09 12:07:02.561864 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:02.561771 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2797f16-a10f-4e26-be32-537e06887f6d" path="/var/lib/kubelet/pods/a2797f16-a10f-4e26-be32-537e06887f6d/volumes" Jun 09 12:07:13.259412 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:13.259376 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-l65tp" Jun 09 12:07:49.350234 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.350199 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:49.354890 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.354864 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:49.357606 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.357575 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rjsws\"" Jun 09 12:07:49.365151 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.365128 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:49.445133 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.445101 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm9vg\" (UniqueName: \"kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg\") pod \"authorino-58cd955675-hsxbt\" (UID: \"d74eedd9-8b89-4040-be22-c98c927761a1\") " pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:49.545596 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.545549 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm9vg\" (UniqueName: \"kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg\") pod \"authorino-58cd955675-hsxbt\" (UID: \"d74eedd9-8b89-4040-be22-c98c927761a1\") " pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:49.554671 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.554638 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm9vg\" (UniqueName: \"kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg\") pod \"authorino-58cd955675-hsxbt\" (UID: \"d74eedd9-8b89-4040-be22-c98c927761a1\") " pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:49.622091 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.622020 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbbn6"] Jun 09 12:07:49.625338 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.625320 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbbn6" Jun 09 12:07:49.634407 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.634381 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbbn6"] Jun 09 12:07:49.664412 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.664380 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:49.747391 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.747361 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bqfv\" (UniqueName: \"kubernetes.io/projected/df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d-kube-api-access-7bqfv\") pod \"authorino-75d556bd77-cbbn6\" (UID: \"df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d\") " pod="kuadrant-system/authorino-75d556bd77-cbbn6" Jun 09 12:07:49.789659 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.789639 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:49.791737 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:07:49.791701 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd74eedd9_8b89_4040_be22_c98c927761a1.slice/crio-01cdb2b95d543b938ac28491a232709c811d8e988c4de633420f07da19d64207 WatchSource:0}: Error finding container 01cdb2b95d543b938ac28491a232709c811d8e988c4de633420f07da19d64207: Status 404 returned error can't find the container with id 01cdb2b95d543b938ac28491a232709c811d8e988c4de633420f07da19d64207 Jun 09 12:07:49.848243 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.848209 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bqfv\" (UniqueName: \"kubernetes.io/projected/df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d-kube-api-access-7bqfv\") pod \"authorino-75d556bd77-cbbn6\" (UID: \"df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d\") " pod="kuadrant-system/authorino-75d556bd77-cbbn6" Jun 09 12:07:49.856474 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.856454 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bqfv\" (UniqueName: \"kubernetes.io/projected/df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d-kube-api-access-7bqfv\") pod \"authorino-75d556bd77-cbbn6\" (UID: \"df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d\") " pod="kuadrant-system/authorino-75d556bd77-cbbn6" Jun 09 12:07:49.935338 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:49.935315 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbbn6" Jun 09 12:07:50.064109 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:50.064065 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbbn6"] Jun 09 12:07:50.463660 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:50.463618 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsxbt" event={"ID":"d74eedd9-8b89-4040-be22-c98c927761a1","Type":"ContainerStarted","Data":"01cdb2b95d543b938ac28491a232709c811d8e988c4de633420f07da19d64207"} Jun 09 12:07:50.464762 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:50.464740 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbbn6" event={"ID":"df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d","Type":"ContainerStarted","Data":"730c83852b6f6c8c3ada7d9524eb92855396f7279366046bdc0ebb5ea6ab23bc"} Jun 09 12:07:53.485547 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:53.485518 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbbn6" event={"ID":"df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d","Type":"ContainerStarted","Data":"cc2f27ef89986f6016ef657f19843e933760f214c138f7620a49ddb8217602d7"} Jun 09 12:07:53.516330 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:53.516271 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cbbn6" podStartSLOduration=1.2346597830000001 podStartE2EDuration="4.516249028s" totalImagesPullingTime="3.281589245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:53.514197191 +0000 UTC m=+787.434079697" watchObservedRunningTime="2026-06-09 12:07:53.516249028 +0000 UTC m=+787.436131534" Jun 09 12:07:53.559054 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:53.559020 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:54.493728 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:54.493680 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsxbt" event={"ID":"d74eedd9-8b89-4040-be22-c98c927761a1","Type":"ContainerStarted","Data":"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8"} Jun 09 12:07:54.513281 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:54.513224 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hsxbt" podStartSLOduration=1.833524656 podStartE2EDuration="5.513204064s" totalImagesPullingTime="3.679679408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:54.512629658 +0000 UTC m=+788.432512177" watchObservedRunningTime="2026-06-09 12:07:54.513204064 +0000 UTC m=+788.433086568" Jun 09 12:07:55.498001 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:55.497960 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hsxbt" podUID="d74eedd9-8b89-4040-be22-c98c927761a1" containerName="authorino" containerID="cri-o://7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8" gracePeriod=30 Jun 09 12:07:55.745510 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:55.745487 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:55.809933 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:55.809849 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm9vg\" (UniqueName: \"kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg\") pod \"d74eedd9-8b89-4040-be22-c98c927761a1\" (UID: \"d74eedd9-8b89-4040-be22-c98c927761a1\") " Jun 09 12:07:55.811853 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:55.811826 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg" (OuterVolumeSpecName: "kube-api-access-zm9vg") pod "d74eedd9-8b89-4040-be22-c98c927761a1" (UID: "d74eedd9-8b89-4040-be22-c98c927761a1"). InnerVolumeSpecName "kube-api-access-zm9vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:07:55.911430 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:55.911389 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm9vg\" (UniqueName: \"kubernetes.io/projected/d74eedd9-8b89-4040-be22-c98c927761a1-kube-api-access-zm9vg\") on node \"ip-10-0-129-85.ec2.internal\" DevicePath \"\"" Jun 09 12:07:56.503571 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.503527 2550 generic.go:356] "Generic (PLEG): container finished" podID="d74eedd9-8b89-4040-be22-c98c927761a1" containerID="7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8" exitCode=0 Jun 09 12:07:56.503571 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.503562 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsxbt" Jun 09 12:07:56.504068 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.503585 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsxbt" event={"ID":"d74eedd9-8b89-4040-be22-c98c927761a1","Type":"ContainerDied","Data":"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8"} Jun 09 12:07:56.504068 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.503636 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsxbt" event={"ID":"d74eedd9-8b89-4040-be22-c98c927761a1","Type":"ContainerDied","Data":"01cdb2b95d543b938ac28491a232709c811d8e988c4de633420f07da19d64207"} Jun 09 12:07:56.504068 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.503653 2550 scope.go:117] "RemoveContainer" containerID="7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8" Jun 09 12:07:56.512318 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.512296 2550 scope.go:117] "RemoveContainer" containerID="7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8" Jun 09 12:07:56.512559 ip-10-0-129-85 kubenswrapper[2550]: E0609 12:07:56.512540 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8\": container with ID starting with 7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8 not found: ID does not exist" containerID="7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8" Jun 09 12:07:56.512620 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.512573 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8"} err="failed to get container status \"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8\": rpc error: code = NotFound desc = could not find container \"7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8\": container with ID starting with 7101ed75dff5b0f665ab2c9a6a272d216b8a3f044ee6c8be3901596d74e719d8 not found: ID does not exist" Jun 09 12:07:56.528013 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.527988 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:56.530398 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.530377 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsxbt"] Jun 09 12:07:56.562451 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:07:56.562430 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74eedd9-8b89-4040-be22-c98c927761a1" path="/var/lib/kubelet/pods/d74eedd9-8b89-4040-be22-c98c927761a1/volumes" Jun 09 12:08:04.103336 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:04.103306 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d556bd77-cbbn6_df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d/authorino/0.log" Jun 09 12:08:08.171273 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:08.171200 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-hf54l_e58f6cac-0898-4f34-8773-37c7c6552716/copy-manifests/0.log" Jun 09 12:08:08.178121 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:08.178089 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-hf54l_e58f6cac-0898-4f34-8773-37c7c6552716/manager/0.log" Jun 09 12:08:09.482076 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:09.482043 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d556bd77-cbbn6_df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d/authorino/0.log" Jun 09 12:08:10.272311 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:10.272279 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-l65tp_2ffe28ab-071a-47ef-b748-412388db1aa4/manager/0.log" Jun 09 12:08:10.968161 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:10.968131 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-prfkw_957ff429-d295-4ecf-b4f3-24d8806161a6/kube-auth-proxy/0.log" Jun 09 12:08:11.185380 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:11.185355 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5857f9576f-9mmx4_b0de5208-4781-4257-8633-b15043087ccd/router/0.log" Jun 09 12:08:18.521715 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:18.521668 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-25wt8_8a7903e8-8f8b-4b73-99b2-441ffce940a2/global-pull-secret-syncer/0.log" Jun 09 12:08:18.677352 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:18.677323 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ctjk7_9b0cd852-2af8-4e7b-9fc6-557eb6a7f801/konnectivity-agent/0.log" Jun 09 12:08:18.747557 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:18.747526 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-85.ec2.internal_bbfeb1994c2bac4a8dfa92f1e1823c15/haproxy/0.log" Jun 09 12:08:24.143512 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:24.143427 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-75d556bd77-cbbn6_df6c6fdb-e3db-41f5-85a5-bfa88dbbb77d/authorino/0.log" Jun 09 12:08:24.384292 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:24.384261 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-l65tp_2ffe28ab-071a-47ef-b748-412388db1aa4/manager/0.log" Jun 09 12:08:26.261161 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.261086 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-ztnmb_822754f0-5188-4306-b13e-3299c46a5ae7/cluster-monitoring-operator/0.log" Jun 09 12:08:26.294252 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.294224 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-r6sz9_f343f79e-f821-4293-b8b0-91ffdf162900/kube-state-metrics/0.log" Jun 09 12:08:26.332253 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.332227 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-r6sz9_f343f79e-f821-4293-b8b0-91ffdf162900/kube-rbac-proxy-main/0.log" Jun 09 12:08:26.373969 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.373947 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-r6sz9_f343f79e-f821-4293-b8b0-91ffdf162900/kube-rbac-proxy-self/0.log" Jun 09 12:08:26.407216 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.407194 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-775d9d78d7-8kn27_55bfe390-4921-4cc3-98ff-9eb6cfda3aea/metrics-server/0.log" Jun 09 12:08:26.674736 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.674655 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kb4zk_ee5540ec-89e6-420a-8503-81497d997feb/node-exporter/0.log" Jun 09 12:08:26.723998 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.723975 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kb4zk_ee5540ec-89e6-420a-8503-81497d997feb/kube-rbac-proxy/0.log" Jun 09 12:08:26.769052 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.769022 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kb4zk_ee5540ec-89e6-420a-8503-81497d997feb/init-textfile/0.log" Jun 09 12:08:26.951644 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.951614 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/prometheus/0.log" Jun 09 12:08:26.982456 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:26.982430 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/config-reloader/0.log" Jun 09 12:08:27.008431 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.008408 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/thanos-sidecar/0.log" Jun 09 12:08:27.033222 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.033199 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/kube-rbac-proxy-web/0.log" Jun 09 12:08:27.061492 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.061470 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/kube-rbac-proxy/0.log" Jun 09 12:08:27.091259 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.091235 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/kube-rbac-proxy-thanos/0.log" Jun 09 12:08:27.123516 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.123496 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61fb689d-84db-4e49-a936-9c1be16f046b/init-config-reloader/0.log" Jun 09 12:08:27.163328 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.163294 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xlxzz_e5994382-e149-4265-a4d6-58522e27e9c1/prometheus-operator/0.log" Jun 09 12:08:27.195324 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:27.195303 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xlxzz_e5994382-e149-4265-a4d6-58522e27e9c1/kube-rbac-proxy/0.log" Jun 09 12:08:28.551102 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.551073 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m"] Jun 09 12:08:28.551472 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.551462 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74eedd9-8b89-4040-be22-c98c927761a1" containerName="authorino" Jun 09 12:08:28.551513 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.551474 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74eedd9-8b89-4040-be22-c98c927761a1" containerName="authorino" Jun 09 12:08:28.551547 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.551529 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74eedd9-8b89-4040-be22-c98c927761a1" containerName="authorino" Jun 09 12:08:28.555875 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.555853 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.559213 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.559191 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96slk\"/\"openshift-service-ca.crt\"" Jun 09 12:08:28.559213 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.559228 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-96slk\"/\"default-dockercfg-kxqrm\"" Jun 09 12:08:28.560288 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.560269 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96slk\"/\"kube-root-ca.crt\"" Jun 09 12:08:28.567513 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.567491 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m"] Jun 09 12:08:28.592323 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.592294 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-proc\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.592323 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.592326 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-sys\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.592489 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.592344 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-lib-modules\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.592489 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.592360 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-podres\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.592489 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.592386 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6zzx\" (UniqueName: \"kubernetes.io/projected/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-kube-api-access-p6zzx\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692810 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692779 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-sys\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692810 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692807 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-lib-modules\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692998 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692824 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-podres\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692998 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692874 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6zzx\" (UniqueName: \"kubernetes.io/projected/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-kube-api-access-p6zzx\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692998 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692906 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-sys\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.692998 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.692943 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-podres\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.693127 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.693002 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-lib-modules\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.693127 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.693014 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-proc\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.693127 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.693105 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-proc\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.702164 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.702142 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6zzx\" (UniqueName: \"kubernetes.io/projected/03c7b0fe-3d07-44d9-810b-71921d0b1c8b-kube-api-access-p6zzx\") pod \"perf-node-gather-daemonset-mjv6m\" (UID: \"03c7b0fe-3d07-44d9-810b-71921d0b1c8b\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:28.867383 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:28.867285 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:29.009335 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.009304 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m"] Jun 09 12:08:29.013359 ip-10-0-129-85 kubenswrapper[2550]: W0609 12:08:29.013329 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03c7b0fe_3d07_44d9_810b_71921d0b1c8b.slice/crio-841a9ee576c7f2b1132aafa8b9bca9fb464b8ef2a21f662c810e34a791999760 WatchSource:0}: Error finding container 841a9ee576c7f2b1132aafa8b9bca9fb464b8ef2a21f662c810e34a791999760: Status 404 returned error can't find the container with id 841a9ee576c7f2b1132aafa8b9bca9fb464b8ef2a21f662c810e34a791999760 Jun 09 12:08:29.579552 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.579509 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/2.log" Jun 09 12:08:29.583831 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.583808 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jj9n8_5343f490-1ad6-4dce-bcf9-f31fa7ec8f4d/console-operator/3.log" Jun 09 12:08:29.646808 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.646781 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" event={"ID":"03c7b0fe-3d07-44d9-810b-71921d0b1c8b","Type":"ContainerStarted","Data":"b674cc13e983c8a77d2e430b321742c954309a7ff5b02fa6d4d42706c1bb47be"} Jun 09 12:08:29.646967 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.646828 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" event={"ID":"03c7b0fe-3d07-44d9-810b-71921d0b1c8b","Type":"ContainerStarted","Data":"841a9ee576c7f2b1132aafa8b9bca9fb464b8ef2a21f662c810e34a791999760"} Jun 09 12:08:29.646967 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.646916 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:29.667578 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:29.667534 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" podStartSLOduration=1.667519344 podStartE2EDuration="1.667519344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:08:29.665960759 +0000 UTC m=+823.585843265" watchObservedRunningTime="2026-06-09 12:08:29.667519344 +0000 UTC m=+823.587401850" Jun 09 12:08:31.835115 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:31.835085 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-644hz_8f409ddb-1c8b-4a17-aabe-913c52391236/dns/0.log" Jun 09 12:08:31.874855 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:31.874826 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-644hz_8f409ddb-1c8b-4a17-aabe-913c52391236/kube-rbac-proxy/0.log" Jun 09 12:08:32.111861 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:32.111789 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zcn4t_4c3b6ba0-5cac-4173-89ff-0eb8a293430a/dns-node-resolver/0.log" Jun 09 12:08:32.712135 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:32.712097 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgqkx_f2dc76ff-a49e-4b15-a1e3-9a56bce4b59c/node-ca/0.log" Jun 09 12:08:33.812336 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:33.812309 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-prfkw_957ff429-d295-4ecf-b4f3-24d8806161a6/kube-auth-proxy/0.log" Jun 09 12:08:33.880914 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:33.880887 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5857f9576f-9mmx4_b0de5208-4781-4257-8633-b15043087ccd/router/0.log" Jun 09 12:08:34.544970 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:34.544932 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjngh_acf32d0a-346d-4fbc-a55c-72f17657cc07/serve-healthcheck-canary/0.log" Jun 09 12:08:35.046023 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.045991 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-cfv2j_3459c5e3-75e5-4330-b655-ece1e1c03f2a/insights-operator/1.log" Jun 09 12:08:35.046617 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.046598 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-cfv2j_3459c5e3-75e5-4330-b655-ece1e1c03f2a/insights-operator/0.log" Jun 09 12:08:35.253008 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.252978 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcq85_930cfeca-f597-4f4c-b27b-f1454942455e/kube-rbac-proxy/0.log" Jun 09 12:08:35.294346 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.294297 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcq85_930cfeca-f597-4f4c-b27b-f1454942455e/exporter/0.log" Jun 09 12:08:35.332416 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.332350 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vcq85_930cfeca-f597-4f4c-b27b-f1454942455e/extractor/0.log" Jun 09 12:08:35.661246 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:35.661178 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-mjv6m" Jun 09 12:08:37.994882 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:37.994856 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-hf54l_e58f6cac-0898-4f34-8773-37c7c6552716/manager/0.log" Jun 09 12:08:38.017972 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:38.017949 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-hf54l_e58f6cac-0898-4f34-8773-37c7c6552716/copy-manifests/0.log" Jun 09 12:08:39.666313 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:39.666228 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c49b6b8b6-7gk84_cd10e9cb-ddd7-4624-b9fd-8839699a3ecc/manager/0.log" Jun 09 12:08:43.301848 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:43.301818 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-prfkw_957ff429-d295-4ecf-b4f3-24d8806161a6/kube-auth-proxy/0.log" Jun 09 12:08:43.348236 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:43.348208 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5857f9576f-9mmx4_b0de5208-4781-4257-8633-b15043087ccd/router/0.log" Jun 09 12:08:44.553601 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:44.553566 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-prfkw_957ff429-d295-4ecf-b4f3-24d8806161a6/kube-auth-proxy/0.log" Jun 09 12:08:44.596027 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:44.595998 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5857f9576f-9mmx4_b0de5208-4781-4257-8633-b15043087ccd/router/0.log" Jun 09 12:08:45.536593 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:45.536559 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-k9mvf_bafab310-40dd-42dc-aaa0-174d252ddd09/kube-storage-version-migrator-operator/1.log" Jun 09 12:08:45.537319 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:45.537299 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-k9mvf_bafab310-40dd-42dc-aaa0-174d252ddd09/kube-storage-version-migrator-operator/0.log" Jun 09 12:08:46.404863 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:46.404830 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-prfkw_957ff429-d295-4ecf-b4f3-24d8806161a6/kube-auth-proxy/0.log" Jun 09 12:08:46.439440 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:46.439417 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5857f9576f-9mmx4_b0de5208-4781-4257-8633-b15043087ccd/router/0.log" Jun 09 12:08:46.796744 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:46.796712 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8hhcl_8b0ea3a4-dc2e-42b2-b83c-6a9a4a78bc2a/kube-multus/0.log" Jun 09 12:08:47.217113 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.217085 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/kube-multus-additional-cni-plugins/0.log" Jun 09 12:08:47.250793 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.250765 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/egress-router-binary-copy/0.log" Jun 09 12:08:47.283752 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.283729 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/cni-plugins/0.log" Jun 09 12:08:47.313904 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.313878 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/bond-cni-plugin/0.log" Jun 09 12:08:47.350036 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.350005 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/routeoverride-cni/0.log" Jun 09 12:08:47.377047 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.377024 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/whereabouts-cni-bincopy/0.log" Jun 09 12:08:47.400799 ip-10-0-129-85 kubenswrapper[2550]: I0609 12:08:47.400774 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qfdts_1da65db6-d300-45d8-98eb-f7e7a91a9490/whereabouts-cni/0.log"