Jul 23 13:26:22.227974 ip-10-0-135-209 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 13:26:22.227986 ip-10-0-135-209 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 13:26:22.227996 ip-10-0-135-209 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 13:26:22.228334 ip-10-0-135-209 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 13:26:32.317074 ip-10-0-135-209 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 13:26:32.317094 ip-10-0-135-209 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6ac297634b1c4d5e97505882be0590c3 -- Jul 23 13:28:25.586792 ip-10-0-135-209 systemd[1]: Starting Kubernetes Kubelet... Jul 23 13:28:25.940875 ip-10-0-135-209 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 13:28:25.940875 ip-10-0-135-209 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 13:28:25.940875 ip-10-0-135-209 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 13:28:25.940875 ip-10-0-135-209 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 13:28:25.940875 ip-10-0-135-209 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 13:28:25.941752 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.941606 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 13:28:25.947919 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947904 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.947919 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947918 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947925 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947929 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947932 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947935 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947938 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947941 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947943 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947946 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947948 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947951 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947953 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947956 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947959 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947961 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947964 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947971 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947974 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947977 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947980 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.947987 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947982 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947985 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947987 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947990 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947993 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947996 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.947998 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948001 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948004 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948007 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948009 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948012 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948014 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948017 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948019 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948022 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948025 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948027 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948030 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.948464 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948033 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948035 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948037 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948040 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948042 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948045 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948047 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948049 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948053 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948056 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948058 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948060 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948063 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948065 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948068 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948071 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948075 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948077 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948080 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.948935 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948083 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948085 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948088 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948091 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948094 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948097 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948099 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948102 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948106 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948109 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948112 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948115 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948119 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948122 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948125 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948128 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948130 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948133 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948135 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948137 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.949415 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948140 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948142 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948145 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948147 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948150 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948152 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948155 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948159 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948163 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948168 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948170 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948173 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948176 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948178 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948181 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948183 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948186 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948189 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948191 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948194 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.949894 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948893 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948903 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948906 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948909 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948912 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948916 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948920 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948922 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948925 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948928 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948931 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948933 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948936 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948939 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948942 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948945 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948949 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948953 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948957 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.950386 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948960 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948964 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948966 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948969 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948972 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948975 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948978 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948980 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948982 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948985 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948988 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948990 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948992 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948995 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.948998 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949001 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949004 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949006 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949009 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949013 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.950852 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949015 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949018 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949020 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949023 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949025 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949028 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949031 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949034 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949036 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949039 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949041 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949044 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949046 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949049 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949052 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949054 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949059 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949063 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949066 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.951371 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949068 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949071 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949074 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949077 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949080 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949082 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949085 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949087 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949090 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949092 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949095 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949097 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949100 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949103 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949106 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949108 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949111 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949114 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949116 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949119 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.951830 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949121 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949124 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949127 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949129 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949132 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949134 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949137 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949139 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949142 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949144 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949147 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949149 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949152 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949154 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949157 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949159 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949162 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949165 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949167 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949170 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.952322 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949172 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949561 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949567 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949571 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949573 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949576 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949580 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949582 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949585 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949588 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949591 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949594 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949596 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949599 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949601 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949605 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949609 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949612 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949615 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.952816 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949618 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949620 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949623 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949626 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949628 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949631 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949634 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949636 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949639 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949642 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949645 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949647 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949650 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949652 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949655 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949658 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949660 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949663 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949665 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949669 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.953261 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949671 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949674 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949676 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949679 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949681 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949684 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949688 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949692 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949695 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949697 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949700 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949703 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949705 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949708 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949710 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949713 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949715 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949718 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949721 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.953791 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949723 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949726 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949728 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949731 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949736 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949738 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949741 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949744 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949747 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949749 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949752 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949754 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949757 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949760 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949764 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949766 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949769 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949771 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949774 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949776 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.954246 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949779 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949781 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949783 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949786 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949788 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949791 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949793 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949795 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949798 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949800 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949803 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949806 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949808 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949811 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949813 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949816 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949822 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949826 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949828 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949831 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.954721 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949834 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.949838 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949912 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949927 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949937 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949943 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949950 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949955 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949961 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949966 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949969 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949972 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949976 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949979 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949982 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949985 2559 flags.go:64] FLAG: --cgroup-root="" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949988 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949991 2559 flags.go:64] FLAG: --client-ca-file="" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949994 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.949997 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950001 2559 flags.go:64] FLAG: --cluster-domain="" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950004 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950010 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950013 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 13:28:25.955211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950016 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950020 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950023 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950026 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950031 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950034 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950037 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950040 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950043 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950046 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950050 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950053 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950056 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950059 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950062 2559 flags.go:64] FLAG: --enable-server="true" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950065 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950069 2559 flags.go:64] FLAG: --event-burst="100" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950073 2559 flags.go:64] FLAG: --event-qps="50" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950075 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950079 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950082 2559 flags.go:64] FLAG: --eviction-hard="" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950085 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950088 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950091 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950094 2559 flags.go:64] FLAG: --eviction-soft="" Jul 23 13:28:25.955793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950097 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950100 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950103 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950106 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950108 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950113 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950116 2559 flags.go:64] FLAG: --feature-gates="" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950119 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950122 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950125 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950128 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950132 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950135 2559 flags.go:64] FLAG: --help="false" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950139 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-209.ec2.internal" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950142 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950145 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950148 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950151 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950155 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950158 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950160 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950163 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950166 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 13:28:25.956405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950170 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950173 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950176 2559 flags.go:64] FLAG: --kube-reserved="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950178 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950181 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950184 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950187 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950190 2559 flags.go:64] FLAG: --lock-file="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950193 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950196 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950199 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950204 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950207 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950210 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950213 2559 flags.go:64] FLAG: --logging-format="text" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950216 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950220 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950222 2559 flags.go:64] FLAG: --manifest-url="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950225 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950230 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950235 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950239 2559 flags.go:64] FLAG: --max-pods="110" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950241 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950244 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950247 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 13:28:25.957019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950250 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950253 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950256 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950259 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950266 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950269 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950272 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950275 2559 flags.go:64] FLAG: --pod-cidr="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950278 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950284 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950287 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950290 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950293 2559 flags.go:64] FLAG: --port="10250" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950296 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950299 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0278fee36de52abea" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950302 2559 flags.go:64] FLAG: --qos-reserved="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950305 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950308 2559 flags.go:64] FLAG: --register-node="true" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950311 2559 flags.go:64] FLAG: --register-with-taints="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950314 2559 flags.go:64] FLAG: --registry-burst="10" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950317 2559 flags.go:64] FLAG: --registry-qps="5" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950321 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950324 2559 flags.go:64] FLAG: --reserved-memory="" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950328 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950331 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 13:28:25.957676 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950334 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950337 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950340 2559 flags.go:64] FLAG: --runonce="false" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950344 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950347 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950350 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950352 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950355 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950358 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950362 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950364 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950367 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950370 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950373 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950376 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950378 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950384 2559 flags.go:64] FLAG: --system-cgroups="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950388 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950394 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950397 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950400 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950404 2559 flags.go:64] FLAG: --tls-min-version="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950407 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950409 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950412 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 13:28:25.958277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950415 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950418 2559 flags.go:64] FLAG: --v="2" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950422 2559 flags.go:64] FLAG: --version="false" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950428 2559 flags.go:64] FLAG: --vmodule="" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950432 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950435 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950584 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950589 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950592 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950595 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950600 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950602 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950605 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950607 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950610 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950612 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950615 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950618 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950620 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950623 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950626 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.958895 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950628 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950631 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950633 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950637 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950640 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950642 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950645 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950647 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950650 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950652 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950655 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950657 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950659 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950662 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950667 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950669 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950672 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950676 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950679 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950682 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.959406 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950685 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950690 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950692 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950695 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950698 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950700 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950702 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950705 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950708 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950710 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950713 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950715 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950718 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950722 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950725 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950728 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950731 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950734 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950736 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950739 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.959901 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950742 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950744 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950747 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950749 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950752 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950754 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950759 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950761 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950764 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950766 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950769 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950771 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950773 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950777 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950780 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950782 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950785 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950788 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950790 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950793 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.960407 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950795 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950798 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950800 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950804 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950807 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950810 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950813 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950816 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950819 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950822 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950824 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950827 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950830 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950832 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950835 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950837 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950840 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950842 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950846 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.960908 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950849 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950851 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950854 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950856 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.950859 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.950864 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.957430 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.957445 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.957457 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.957463 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957536 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957541 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957544 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957547 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.961363 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957550 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957553 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957556 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957560 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957564 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957566 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957570 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957574 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957577 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957579 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957582 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957585 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957587 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957590 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957592 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957594 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957597 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957600 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957602 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.961724 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957605 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957608 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957610 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957613 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957616 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957618 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957623 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957626 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957629 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957632 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957635 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957637 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957640 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957643 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957645 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957648 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957651 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957654 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957656 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.962166 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957659 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957662 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957664 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957667 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957669 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957671 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957674 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957677 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957679 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957682 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957685 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957688 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957690 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957693 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957696 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957698 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957701 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957703 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957706 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957708 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.962628 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957711 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957714 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957716 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957719 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957721 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957724 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957726 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957728 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957731 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957733 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957736 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957738 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957741 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957743 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957745 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957748 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957751 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957753 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957756 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.963111 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957758 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957760 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957763 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957765 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957767 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957770 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957772 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957775 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957777 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957780 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957782 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957785 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957787 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957790 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957793 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957795 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957798 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.963611 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957800 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.957805 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957913 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957917 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957921 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957923 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957927 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957931 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957934 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957936 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957939 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957941 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957944 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957946 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 13:28:25.964019 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957949 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957951 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957954 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957956 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957959 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957962 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957964 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957966 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957969 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957972 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957974 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957977 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957980 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957982 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957985 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957988 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957991 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957994 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957996 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.957999 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 13:28:25.964368 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958001 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958003 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958006 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958008 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958010 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958013 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958015 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958018 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958020 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958023 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958025 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958027 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958030 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958032 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958035 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958037 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958039 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958042 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958044 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958047 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 13:28:25.965102 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958049 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958052 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958054 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958057 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958059 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958062 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958064 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958067 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958070 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958073 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958077 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958080 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958083 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958086 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958088 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958091 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958093 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958096 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958098 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958101 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 13:28:25.965698 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958103 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958106 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958108 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958111 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958113 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958116 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958118 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958120 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958123 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958126 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958128 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958130 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958133 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958135 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958138 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958140 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958144 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958147 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958150 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 13:28:25.966479 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958153 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958155 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958158 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958160 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958163 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958165 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958168 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:25.958170 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.958175 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.958270 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.960812 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.961976 2559 server.go:1019] "Starting client certificate rotation" Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.962078 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 13:28:25.967049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.962116 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 13:28:25.967370 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.964657 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 13:28:25.967537 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.967522 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 13:28:25.981107 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.981091 2559 log.go:25] "Validated CRI v1 runtime API" Jul 23 13:28:25.983018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.983003 2559 log.go:25] "Validated CRI v1 image API" Jul 23 13:28:25.983822 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.983802 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 13:28:25.986703 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.986677 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9151ce2e-8f36-4796-a005-d3a8a0a22631:/dev/nvme0n1p4 de84e801-ded9-4c16-9c65-74f8d0abed5d:/dev/nvme0n1p3] Jul 23 13:28:25.986775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.986703 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 13:28:25.992119 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.992010 2559 manager.go:216] Machine: {Timestamp:2026-07-23 13:28:25.990677928 +0000 UTC m=+0.298055782 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101108 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bbe05631804ca9d03c60e0d7923bc SystemUUID:ec2bbe05-6318-04ca-9d03-c60e0d7923bc BootID:6ac29763-4b1c-4d5e-9750-5882be0590c3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:e0:27:78:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:e0:27:78:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:9b:01:e0:8f:fc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 13:28:25.992119 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.992109 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 13:28:25.992227 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.992212 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 13:28:25.993052 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.993034 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 13:28:25.998226 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998200 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 13:28:25.998362 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998229 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-209.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 13:28:25.998854 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998844 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 13:28:25.998886 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998857 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 13:28:25.998886 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998864 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 13:28:25.998886 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:25.998880 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 13:28:26.000554 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.000544 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 13:28:26.003938 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.003927 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 23 13:28:26.004044 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004034 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 13:28:26.004075 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004064 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 23 13:28:26.004075 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004073 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 13:28:26.004125 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004087 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 13:28:26.004125 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004097 2559 kubelet.go:398] "Adding apiserver pod source" Jul 23 13:28:26.004125 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004106 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 13:28:26.004447 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004435 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 13:28:26.004483 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.004454 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 13:28:26.006702 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.006682 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 13:28:26.008326 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.008313 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 13:28:26.008372 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.008342 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 13:28:26.009347 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009337 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009351 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009358 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009363 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009372 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009380 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 13:28:26.009392 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009392 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 13:28:26.009563 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009400 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 13:28:26.009563 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009410 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 13:28:26.009563 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009416 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 13:28:26.009563 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009424 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 13:28:26.009563 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.009429 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 13:28:26.010878 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.010866 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 13:28:26.010878 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.010877 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 13:28:26.013974 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.013959 2559 server.go:1268] "Started kubelet" Jul 23 13:28:26.014089 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.014063 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 13:28:26.014933 ip-10-0-135-209 systemd[1]: Started Kubernetes Kubelet. Jul 23 13:28:26.017782 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.017615 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 13:28:26.017891 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.017819 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 13:28:26.018805 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.018752 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-209.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 13:28:26.019006 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.018977 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 13:28:26.019177 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.019161 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 13:28:26.019413 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.019388 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 13:28:26.020646 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.020435 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 23 13:28:26.021713 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.021687 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 13:28:26.024833 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.023883 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18c4ee3ed759f6f5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-07-23 13:28:26.013939445 +0000 UTC m=+0.321317299,LastTimestamp:2026-07-23 13:28:26.013939445 +0000 UTC m=+0.321317299,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Jul 23 13:28:26.026639 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.026624 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 13:28:26.026702 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.026629 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 13:28:26.026779 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.026753 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.027293 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027262 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 13:28:26.027406 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027388 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 13:28:26.027469 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027408 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 13:28:26.027592 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027577 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 23 13:28:26.027592 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027590 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 23 13:28:26.027801 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027773 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 13:28:26.027801 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027791 2559 factory.go:55] Registering systemd factory Jul 23 13:28:26.027801 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.027800 2559 factory.go:223] Registration of the systemd container factory successfully Jul 23 13:28:26.028165 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.028150 2559 factory.go:153] Registering CRI-O factory Jul 23 13:28:26.028165 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.028166 2559 factory.go:223] Registration of the crio container factory successfully Jul 23 13:28:26.028277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.028186 2559 factory.go:103] Registering Raw factory Jul 23 13:28:26.028277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.028201 2559 manager.go:1196] Started watching for new ooms in manager Jul 23 13:28:26.028606 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.028593 2559 manager.go:349] Starting recovery of all containers Jul 23 13:28:26.030807 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.030766 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 13:28:26.038659 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.038618 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-209.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 13:28:26.039177 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.039164 2559 manager.go:354] Recovery completed Jul 23 13:28:26.043693 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.043677 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.048520 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.048489 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.048576 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.048555 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.048576 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.048574 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.049158 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.049141 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 13:28:26.049158 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.049154 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 13:28:26.049232 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.049171 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 23 13:28:26.049232 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.049183 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.049987 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.049972 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.050034 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.050000 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.050034 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.050009 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.050888 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.050214 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18c4ee3ed969a500 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-209.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-07-23 13:28:26.048521472 +0000 UTC m=+0.355899327,LastTimestamp:2026-07-23 13:28:26.048521472 +0000 UTC m=+0.355899327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Jul 23 13:28:26.051159 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.051142 2559 policy_none.go:49] "None policy: Start" Jul 23 13:28:26.051239 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.051164 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 13:28:26.051304 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.051283 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 13:28:26.051838 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.051819 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pwvt2" Jul 23 13:28:26.053490 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.053476 2559 policy_none.go:47] "Start" Jul 23 13:28:26.058585 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.058435 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pwvt2" Jul 23 13:28:26.063609 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.063544 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-209.ec2.internal.18c4ee3ed96a4320 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-209.ec2.internal,UID:ip-10-0-135-209.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-209.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-209.ec2.internal,},FirstTimestamp:2026-07-23 13:28:26.048561952 +0000 UTC m=+0.355939805,LastTimestamp:2026-07-23 13:28:26.048561952 +0000 UTC m=+0.355939805,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-209.ec2.internal,}" Jul 23 13:28:26.088042 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088028 2559 manager.go:337] "Starting Device Plugin manager" Jul 23 13:28:26.088132 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.088057 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 13:28:26.088132 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088067 2559 server.go:87] "Starting device plugin registration server" Jul 23 13:28:26.088288 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088278 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 13:28:26.088333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088290 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 13:28:26.088405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088388 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 13:28:26.088478 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088466 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 13:28:26.088547 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.088478 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 13:28:26.089002 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.088980 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 13:28:26.089075 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.089030 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.146988 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.146957 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 13:28:26.149167 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.148183 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 13:28:26.149167 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.148227 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 13:28:26.149167 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.148251 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 13:28:26.149167 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.148291 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 13:28:26.151095 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.151073 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 13:28:26.189338 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.189314 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.190230 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.190201 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.190322 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.190244 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.190322 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.190261 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.190322 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.190290 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.201052 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.201007 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.201052 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.201029 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-209.ec2.internal\": node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.248562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.248533 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal"] Jul 23 13:28:26.248661 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.248606 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.250593 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.250576 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.250677 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.250609 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.250677 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.250624 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.253053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.253040 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.253195 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.253176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.253232 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.253208 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.254142 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254126 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.254142 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254136 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.254238 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254153 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.254238 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254157 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.254238 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254163 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.254238 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.254168 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.256406 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.256393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.256474 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.256418 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:26.257218 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.257204 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:26.257279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.257234 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:26.257279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.257248 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:26.276145 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.276128 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-209.ec2.internal\" not found" node="ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.280585 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.280565 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-209.ec2.internal\" not found" node="ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.287547 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.287529 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.329993 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.329961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.329993 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.329992 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.330152 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.330012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb35003e3a2089e3489c75f90e5d25fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bb35003e3a2089e3489c75f90e5d25fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.387980 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.387951 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.430659 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.430659 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430660 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb35003e3a2089e3489c75f90e5d25fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bb35003e3a2089e3489c75f90e5d25fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.430820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.430820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430729 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bb35003e3a2089e3489c75f90e5d25fe-config\") pod \"kube-apiserver-proxy-ip-10-0-135-209.ec2.internal\" (UID: \"bb35003e3a2089e3489c75f90e5d25fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.430820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.430820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.430775 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b269e6e4157a42bf31cb36998ee3b9da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal\" (UID: \"b269e6e4157a42bf31cb36998ee3b9da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.489982 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.489950 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.582544 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.582490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.583723 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.583700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:26.590099 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.590076 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.694350 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.694309 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.799134 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.799044 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.899518 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:26.899462 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:26.961823 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.961796 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 13:28:26.962321 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:26.962000 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 13:28:27.001466 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:27.001433 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:27.063647 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.063561 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 13:23:26 +0000 UTC" deadline="2028-04-23 17:25:38.400152382 +0000 UTC" Jul 23 13:28:27.063647 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.063605 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15363h57m11.336559038s" Jul 23 13:28:27.083797 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.083766 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 13:28:27.085291 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.085271 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientMemory" Jul 23 13:28:27.085405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.085304 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 13:28:27.085405 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.085316 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeHasSufficientPID" Jul 23 13:28:27.102066 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:27.102044 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-209.ec2.internal\" not found" Jul 23 13:28:27.116133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.116109 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 13:28:27.126972 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.126940 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" Jul 23 13:28:27.136307 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.136286 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 13:28:27.140322 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.140305 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 13:28:27.141269 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.141255 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" Jul 23 13:28:27.160884 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.160861 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 13:28:27.205545 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:27.205518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb35003e3a2089e3489c75f90e5d25fe.slice/crio-58bb2313d8507e870a6cea7ec1f76122c07358ffb3758b4115f7bb97e941b27d WatchSource:0}: Error finding container 58bb2313d8507e870a6cea7ec1f76122c07358ffb3758b4115f7bb97e941b27d: Status 404 returned error can't find the container with id 58bb2313d8507e870a6cea7ec1f76122c07358ffb3758b4115f7bb97e941b27d Jul 23 13:28:27.206149 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:27.206125 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb269e6e4157a42bf31cb36998ee3b9da.slice/crio-eab7da0c0df263d9e6d36f5e045242f10d96aba5fb9dad3284104c332e03dea4 WatchSource:0}: Error finding container eab7da0c0df263d9e6d36f5e045242f10d96aba5fb9dad3284104c332e03dea4: Status 404 returned error can't find the container with id eab7da0c0df263d9e6d36f5e045242f10d96aba5fb9dad3284104c332e03dea4 Jul 23 13:28:27.211718 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.211698 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 13:28:27.576106 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.576070 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 13:28:27.862556 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:27.862463 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 13:28:28.005397 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.005363 2559 apiserver.go:52] "Watching apiserver" Jul 23 13:28:28.015312 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.015287 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 13:28:28.016399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.016366 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-j8lxf","openshift-multus/network-metrics-daemon-zsddw","openshift-ovn-kubernetes/ovnkube-node-wc7f2","kube-system/konnectivity-agent-fbxln","kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r","openshift-image-registry/node-ca-b2v75","openshift-multus/multus-jlxx2","openshift-network-diagnostics/network-check-target-74tzz","openshift-network-operator/iptables-alerter-vd7jb","kube-system/global-pull-secret-syncer-xl7cf","openshift-cluster-node-tuning-operator/tuned-nh9mx","openshift-dns/node-resolver-5xbzw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal"] Jul 23 13:28:28.018942 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.018920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.021287 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.021262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.021490 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.021454 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 13:28:28.021661 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.021618 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.021882 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.021860 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.021882 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.021877 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m87j7\"" Jul 23 13:28:28.023265 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.023093 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.023361 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.023296 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 13:28:28.024310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.023681 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 13:28:28.024310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.023888 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gkmnl\"" Jul 23 13:28:28.024310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.023916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 13:28:28.024310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.024040 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.024310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.024127 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.025851 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.025831 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.026120 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.026093 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.026221 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.026209 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.026600 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.026452 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 13:28:28.026694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.026628 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g7vf2\"" Jul 23 13:28:28.027549 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.027529 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 13:28:28.028250 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.028233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 13:28:28.028356 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.028240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s9kxn\"" Jul 23 13:28:28.028570 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.028550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 13:28:28.028985 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.028929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.031304 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031284 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 13:28:28.031572 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031500 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.031572 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031500 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-znn7h\"" Jul 23 13:28:28.031706 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031585 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 13:28:28.031706 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031655 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 13:28:28.031873 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031845 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.031969 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.031957 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.032063 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.032040 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:28.033019 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.032993 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 13:28:28.035683 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.035648 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.037847 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.037825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mnj48\"" Jul 23 13:28:28.037946 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.037830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 13:28:28.038251 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:28.038331 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.038307 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:28.038923 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-serviceca\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.039018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef724c99-74b1-42d1-b1f5-8b0d7617218b-agent-certs\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.039018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-ovn\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-log-socket\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.038993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-config\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovn-node-metrics-cert\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-device-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-host\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-systemd-units\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-kubelet\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-systemd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-etc-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr4zp\" (UniqueName: \"kubernetes.io/projected/6e493d4b-f257-49b4-9e95-7a84bf95928a-kube-api-access-hr4zp\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-slash\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-netns\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-node-log\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7mf\" (UniqueName: \"kubernetes.io/projected/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kube-api-access-pg7mf\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.039650 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039615 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-os-release\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef724c99-74b1-42d1-b1f5-8b0d7617218b-konnectivity-ca\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-var-lib-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-env-overrides\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-registration-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-sys-fs\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvhqc\" (UniqueName: \"kubernetes.io/projected/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-kube-api-access-nvhqc\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-bin\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-script-lib\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-socket-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.039998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbm8r\" (UniqueName: \"kubernetes.io/projected/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-kube-api-access-nbm8r\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.040040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-netd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.040216 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.040088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cnibin\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.040921 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.040901 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.042719 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.042697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rs5ts\"" Jul 23 13:28:28.043046 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.043025 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.043138 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.043075 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.043204 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.043180 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 13:28:28.043448 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.043427 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.043534 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.043497 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:28.045840 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.045823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.047866 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.047845 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r7pgw\"" Jul 23 13:28:28.047960 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.047885 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.047960 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.047947 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.048301 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.048282 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.050138 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.050115 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 13:28:28.050264 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.050243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxhb2\"" Jul 23 13:28:28.050385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.050362 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 13:28:28.065930 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.065908 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kfl2z" Jul 23 13:28:28.074881 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.074863 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kfl2z" Jul 23 13:28:28.129027 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.128946 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 13:28:28.140996 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.140961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141151 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-multus-certs\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.141151 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-var-lib-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141151 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141151 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-env-overrides\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a52c75d5-60a4-4087-8906-b9fc00c78c70-hosts-file\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141190 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-var-lib-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6s5b\" (UniqueName: \"kubernetes.io/projected/ca30a538-b7c1-4e4c-940e-7e8e16758427-kube-api-access-j6s5b\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cni-binary-copy\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-socket-dir-parent\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-bin\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jdm\" (UniqueName: \"kubernetes.io/projected/a52c75d5-60a4-4087-8906-b9fc00c78c70-kube-api-access-78jdm\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-netd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-ovn\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-device-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysconfig\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-kubernetes\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-multus\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-var-lib-kubelet\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-host\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-lib-modules\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-host\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141694 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-env-overrides\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-netns\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-bin\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr4zp\" (UniqueName: \"kubernetes.io/projected/6e493d4b-f257-49b4-9e95-7a84bf95928a-kube-api-access-hr4zp\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141848 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-host\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.141883 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141857 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-ovn\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141889 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-device-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141903 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-cni-netd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141854 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.141988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-systemd\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-node-log\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-node-log\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7mf\" (UniqueName: \"kubernetes.io/projected/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kube-api-access-pg7mf\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-os-release\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvhqc\" (UniqueName: \"kubernetes.io/projected/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-kube-api-access-nvhqc\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.142760 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-conf\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-tuned\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-etc-kubernetes\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef724c99-74b1-42d1-b1f5-8b0d7617218b-konnectivity-ca\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-os-release\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142548 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-registration-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-sys-fs\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-bin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-kubelet\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-script-lib\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142738 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-registration-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-socket-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142805 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-sys-fs\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.143720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-tmp\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-os-release\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-hostroot\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbm8r\" (UniqueName: \"kubernetes.io/projected/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-kube-api-access-nbm8r\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cnibin\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-socket-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-run\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgf4\" (UniqueName: \"kubernetes.io/projected/1f52cde9-c7ee-4002-98dc-adab6c16ff42-kube-api-access-kxgf4\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.142991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52c75d5-60a4-4087-8906-b9fc00c78c70-tmp-dir\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-system-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-k8s-cni-cncf-io\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143077 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ef724c99-74b1-42d1-b1f5-8b0d7617218b-konnectivity-ca\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-serviceca\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef724c99-74b1-42d1-b1f5-8b0d7617218b-agent-certs\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-log-socket\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-config\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.144722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143194 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovn-node-metrics-cert\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-dbus\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cnibin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55d26310-2da8-44da-a416-abd9a03bec08-iptables-alerter-script\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d26310-2da8-44da-a416-abd9a03bec08-host-slash\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pntk9\" (UniqueName: \"kubernetes.io/projected/55d26310-2da8-44da-a416-abd9a03bec08-kube-api-access-pntk9\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-systemd-units\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-conf-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-daemon-config\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143516 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hllj7\" (UniqueName: \"kubernetes.io/projected/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-kube-api-access-hllj7\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-kubelet\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cnibin\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.145407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-systemd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-log-socket\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-etc-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143723 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-kubelet\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143762 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-modprobe-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143774 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143760 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-sys\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143821 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-systemd\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-etc-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-kubelet-config\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-slash\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-netns\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143944 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-script-lib\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.143995 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-slash\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.145970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.144033 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-systemd-units\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.146696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.144036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovnkube-config\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.146696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.144055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-serviceca\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.146696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.144072 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-run-openvswitch\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.146696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.144112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e493d4b-f257-49b4-9e95-7a84bf95928a-host-run-netns\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.147597 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.147563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e493d4b-f257-49b4-9e95-7a84bf95928a-ovn-node-metrics-cert\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.147695 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.147599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ef724c99-74b1-42d1-b1f5-8b0d7617218b-agent-certs\") pod \"konnectivity-agent-fbxln\" (UID: \"ef724c99-74b1-42d1-b1f5-8b0d7617218b\") " pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.151296 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.151273 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvhqc\" (UniqueName: \"kubernetes.io/projected/ee4c17db-1d7b-4409-a34b-e575cbdc4ea6-kube-api-access-nvhqc\") pod \"multus-additional-cni-plugins-j8lxf\" (UID: \"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6\") " pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.151805 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.151771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr4zp\" (UniqueName: \"kubernetes.io/projected/6e493d4b-f257-49b4-9e95-7a84bf95928a-kube-api-access-hr4zp\") pod \"ovnkube-node-wc7f2\" (UID: \"6e493d4b-f257-49b4-9e95-7a84bf95928a\") " pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.152018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.151996 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7mf\" (UniqueName: \"kubernetes.io/projected/75dd9272-c9cc-462b-9cd5-8c8c4f054df6-kube-api-access-pg7mf\") pod \"aws-ebs-csi-driver-node-jq52r\" (UID: \"75dd9272-c9cc-462b-9cd5-8c8c4f054df6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.153293 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.153270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbm8r\" (UniqueName: \"kubernetes.io/projected/199b62d0-5ee5-4dbf-90c8-6aa843c3cce1-kube-api-access-nbm8r\") pod \"node-ca-b2v75\" (UID: \"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1\") " pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.153395 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.153339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" event={"ID":"bb35003e3a2089e3489c75f90e5d25fe","Type":"ContainerStarted","Data":"58bb2313d8507e870a6cea7ec1f76122c07358ffb3758b4115f7bb97e941b27d"} Jul 23 13:28:28.154850 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.154829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"b269e6e4157a42bf31cb36998ee3b9da","Type":"ContainerStarted","Data":"eab7da0c0df263d9e6d36f5e045242f10d96aba5fb9dad3284104c332e03dea4"} Jul 23 13:28:28.244307 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a52c75d5-60a4-4087-8906-b9fc00c78c70-hosts-file\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.244500 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6s5b\" (UniqueName: \"kubernetes.io/projected/ca30a538-b7c1-4e4c-940e-7e8e16758427-kube-api-access-j6s5b\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.244500 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cni-binary-copy\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244500 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-socket-dir-parent\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244500 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jdm\" (UniqueName: \"kubernetes.io/projected/a52c75d5-60a4-4087-8906-b9fc00c78c70-kube-api-access-78jdm\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.244751 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysconfig\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244751 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244549 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-kubernetes\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244751 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-multus\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244751 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244688 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-socket-dir-parent\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244751 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-var-lib-kubelet\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-multus\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-lib-modules\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a52c75d5-60a4-4087-8906-b9fc00c78c70-hosts-file\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-host\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244833 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-netns\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244843 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysconfig\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244857 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-kubernetes\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244769 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-var-lib-kubelet\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-systemd\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-host\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.244991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244943 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-conf\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-tuned\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-etc-kubernetes\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-bin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-conf\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-kubelet\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-etc-kubernetes\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244943 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-netns\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244983 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-sysctl-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244981 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-lib-modules\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.244974 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-systemd\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-cni-bin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-tmp\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245159 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-var-lib-kubelet\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-os-release\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-hostroot\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245280 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-hostroot\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-os-release\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.245624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-run\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgf4\" (UniqueName: \"kubernetes.io/projected/1f52cde9-c7ee-4002-98dc-adab6c16ff42-kube-api-access-kxgf4\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52c75d5-60a4-4087-8906-b9fc00c78c70-tmp-dir\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-system-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245443 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-run\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-k8s-cni-cncf-io\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-dbus\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cnibin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55d26310-2da8-44da-a416-abd9a03bec08-iptables-alerter-script\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245635 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cni-binary-copy\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d26310-2da8-44da-a416-abd9a03bec08-host-slash\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pntk9\" (UniqueName: \"kubernetes.io/projected/55d26310-2da8-44da-a416-abd9a03bec08-kube-api-access-pntk9\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245730 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a52c75d5-60a4-4087-8906-b9fc00c78c70-tmp-dir\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245781 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-dbus\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-conf-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.246456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245832 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-k8s-cni-cncf-io\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-daemon-config\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.245881 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245886 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-system-cni-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hllj7\" (UniqueName: \"kubernetes.io/projected/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-kube-api-access-hllj7\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.245948 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:28.745926275 +0000 UTC m=+3.053304150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.245974 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.245985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-modprobe-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-sys\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.246039 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:28.746019304 +0000 UTC m=+3.053397152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-sys\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246075 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-kubelet-config\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55d26310-2da8-44da-a416-abd9a03bec08-host-slash\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246113 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-multus-certs\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-conf-dir\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-host-run-multus-certs\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-cnibin\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.247970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246277 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-kubelet-config\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.247970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246366 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-modprobe-d\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.247970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55d26310-2da8-44da-a416-abd9a03bec08-iptables-alerter-script\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.247970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.246724 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-multus-daemon-config\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.248162 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.248059 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-etc-tuned\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.248294 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.248274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f52cde9-c7ee-4002-98dc-adab6c16ff42-tmp\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.255763 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.255730 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:28.255763 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.255761 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:28.255965 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.255777 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:28.255965 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.255844 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:28.755823061 +0000 UTC m=+3.063200922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:28.257606 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.257547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6s5b\" (UniqueName: \"kubernetes.io/projected/ca30a538-b7c1-4e4c-940e-7e8e16758427-kube-api-access-j6s5b\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.258057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.258026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jdm\" (UniqueName: \"kubernetes.io/projected/a52c75d5-60a4-4087-8906-b9fc00c78c70-kube-api-access-78jdm\") pod \"node-resolver-5xbzw\" (UID: \"a52c75d5-60a4-4087-8906-b9fc00c78c70\") " pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.258469 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.258448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgf4\" (UniqueName: \"kubernetes.io/projected/1f52cde9-c7ee-4002-98dc-adab6c16ff42-kube-api-access-kxgf4\") pod \"tuned-nh9mx\" (UID: \"1f52cde9-c7ee-4002-98dc-adab6c16ff42\") " pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.259149 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.259126 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pntk9\" (UniqueName: \"kubernetes.io/projected/55d26310-2da8-44da-a416-abd9a03bec08-kube-api-access-pntk9\") pod \"iptables-alerter-vd7jb\" (UID: \"55d26310-2da8-44da-a416-abd9a03bec08\") " pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.259935 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.259914 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hllj7\" (UniqueName: \"kubernetes.io/projected/1cbccaf9-6015-41b0-a84f-d9cb1ba8897d-kube-api-access-hllj7\") pod \"multus-jlxx2\" (UID: \"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d\") " pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.333885 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.333851 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" Jul 23 13:28:28.348315 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.348290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" Jul 23 13:28:28.357131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.357105 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2v75" Jul 23 13:28:28.363128 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.363106 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:28.370210 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.370188 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:28.377149 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.377126 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlxx2" Jul 23 13:28:28.385079 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.385052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vd7jb" Jul 23 13:28:28.393061 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.393029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" Jul 23 13:28:28.399767 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.399734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xbzw" Jul 23 13:28:28.637674 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.637640 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4c17db_1d7b_4409_a34b_e575cbdc4ea6.slice/crio-3890a2765bfdc647a8b0502df882105789880843a0b9cb21770a4d7f0de2c13a WatchSource:0}: Error finding container 3890a2765bfdc647a8b0502df882105789880843a0b9cb21770a4d7f0de2c13a: Status 404 returned error can't find the container with id 3890a2765bfdc647a8b0502df882105789880843a0b9cb21770a4d7f0de2c13a Jul 23 13:28:28.640311 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.640288 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbccaf9_6015_41b0_a84f_d9cb1ba8897d.slice/crio-75c5a7bc3fa7bda44198cda820f75217a92271181c45827805afeead8215a94c WatchSource:0}: Error finding container 75c5a7bc3fa7bda44198cda820f75217a92271181c45827805afeead8215a94c: Status 404 returned error can't find the container with id 75c5a7bc3fa7bda44198cda820f75217a92271181c45827805afeead8215a94c Jul 23 13:28:28.643031 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.643006 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef724c99_74b1_42d1_b1f5_8b0d7617218b.slice/crio-5eaba3d76cea2927928271fcab4779a63e867a69c97db580fc20899d03a64f54 WatchSource:0}: Error finding container 5eaba3d76cea2927928271fcab4779a63e867a69c97db580fc20899d03a64f54: Status 404 returned error can't find the container with id 5eaba3d76cea2927928271fcab4779a63e867a69c97db580fc20899d03a64f54 Jul 23 13:28:28.645784 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.645742 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d26310_2da8_44da_a416_abd9a03bec08.slice/crio-95b70c85ed814ff62091a358ed4788a6b214c6c5522278ff05abf8ffe2885032 WatchSource:0}: Error finding container 95b70c85ed814ff62091a358ed4788a6b214c6c5522278ff05abf8ffe2885032: Status 404 returned error can't find the container with id 95b70c85ed814ff62091a358ed4788a6b214c6c5522278ff05abf8ffe2885032 Jul 23 13:28:28.646899 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.646876 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199b62d0_5ee5_4dbf_90c8_6aa843c3cce1.slice/crio-bec3b681b7916c43127762758a265d038346396efaebf26c0f94a47dfc245dc0 WatchSource:0}: Error finding container bec3b681b7916c43127762758a265d038346396efaebf26c0f94a47dfc245dc0: Status 404 returned error can't find the container with id bec3b681b7916c43127762758a265d038346396efaebf26c0f94a47dfc245dc0 Jul 23 13:28:28.647520 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.647450 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dd9272_c9cc_462b_9cd5_8c8c4f054df6.slice/crio-52d96e4a7ba81b71a68597b6cc10cccbbe805e9042635bb36d45659be9d745ff WatchSource:0}: Error finding container 52d96e4a7ba81b71a68597b6cc10cccbbe805e9042635bb36d45659be9d745ff: Status 404 returned error can't find the container with id 52d96e4a7ba81b71a68597b6cc10cccbbe805e9042635bb36d45659be9d745ff Jul 23 13:28:28.670160 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:28:28.670137 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f52cde9_c7ee_4002_98dc_adab6c16ff42.slice/crio-a3172ec4129a4fd48e5768f334eaf864676ec73730e3e9a4dc003902c8377dda WatchSource:0}: Error finding container a3172ec4129a4fd48e5768f334eaf864676ec73730e3e9a4dc003902c8377dda: Status 404 returned error can't find the container with id a3172ec4129a4fd48e5768f334eaf864676ec73730e3e9a4dc003902c8377dda Jul 23 13:28:28.750465 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.750434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:28.750641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.750473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:28.750641 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.750599 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:28.750733 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.750673 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:28.750733 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.750678 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:29.750661371 +0000 UTC m=+4.058039217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:28.750733 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.750714 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:29.750702301 +0000 UTC m=+4.058080148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:28.850917 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:28.850890 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:28.851103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.851020 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:28.851103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.851036 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:28.851103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.851045 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:28.851103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:28.851101 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:29.851088037 +0000 UTC m=+4.158465880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:29.078682 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.078338 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:23:28 +0000 UTC" deadline="2028-02-29 21:36:47.001294637 +0000 UTC" Jul 23 13:28:29.078682 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.078682 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14072h8m17.922619926s" Jul 23 13:28:29.148687 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.148610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:29.148870 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.148760 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:29.158802 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.158729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vd7jb" event={"ID":"55d26310-2da8-44da-a416-abd9a03bec08","Type":"ContainerStarted","Data":"95b70c85ed814ff62091a358ed4788a6b214c6c5522278ff05abf8ffe2885032"} Jul 23 13:28:29.162938 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.162899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerStarted","Data":"3890a2765bfdc647a8b0502df882105789880843a0b9cb21770a4d7f0de2c13a"} Jul 23 13:28:29.166513 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.166482 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xbzw" event={"ID":"a52c75d5-60a4-4087-8906-b9fc00c78c70","Type":"ContainerStarted","Data":"3429c23a0173df02f12789e274a084ea4ec80325b4ab350b0822affb4bf87719"} Jul 23 13:28:29.173097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.172978 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"0622d95027f095a831fca66aefdc096e9edcbec8c0cf00fb35f30c8c20718d03"} Jul 23 13:28:29.181611 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.180971 2559 generic.go:356] "Generic (PLEG): container finished" podID="b269e6e4157a42bf31cb36998ee3b9da" containerID="4e849fd722b87d385f960eaf67701ff5dd15204c5d01916e25e9d46d273af959" exitCode=0 Jul 23 13:28:29.181738 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.181677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"b269e6e4157a42bf31cb36998ee3b9da","Type":"ContainerDied","Data":"4e849fd722b87d385f960eaf67701ff5dd15204c5d01916e25e9d46d273af959"} Jul 23 13:28:29.183494 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.183462 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbxln" event={"ID":"ef724c99-74b1-42d1-b1f5-8b0d7617218b","Type":"ContainerStarted","Data":"5eaba3d76cea2927928271fcab4779a63e867a69c97db580fc20899d03a64f54"} Jul 23 13:28:29.187173 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.187119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlxx2" event={"ID":"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d","Type":"ContainerStarted","Data":"75c5a7bc3fa7bda44198cda820f75217a92271181c45827805afeead8215a94c"} Jul 23 13:28:29.190979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.190933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" event={"ID":"1f52cde9-c7ee-4002-98dc-adab6c16ff42","Type":"ContainerStarted","Data":"a3172ec4129a4fd48e5768f334eaf864676ec73730e3e9a4dc003902c8377dda"} Jul 23 13:28:29.192789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.192707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" event={"ID":"75dd9272-c9cc-462b-9cd5-8c8c4f054df6","Type":"ContainerStarted","Data":"52d96e4a7ba81b71a68597b6cc10cccbbe805e9042635bb36d45659be9d745ff"} Jul 23 13:28:29.194202 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.194094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2v75" event={"ID":"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1","Type":"ContainerStarted","Data":"bec3b681b7916c43127762758a265d038346396efaebf26c0f94a47dfc245dc0"} Jul 23 13:28:29.759261 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.759222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:29.759473 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.759282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:29.759473 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.759457 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:29.759623 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.759523 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:31.759503431 +0000 UTC m=+6.066881293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:29.759987 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.759968 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:29.760052 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.760028 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:31.760012108 +0000 UTC m=+6.067389958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:29.861037 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:29.860257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:29.861037 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.860553 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:29.861037 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.860578 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:29.861037 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.860592 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:29.861037 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:29.860668 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:31.860648584 +0000 UTC m=+6.168026434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:30.079357 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:30.079213 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:23:28 +0000 UTC" deadline="2028-04-12 00:27:52.67822059 +0000 UTC" Jul 23 13:28:30.079357 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:30.079275 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15082h59m22.598950972s" Jul 23 13:28:30.149335 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:30.148776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:30.149335 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:30.148919 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:30.149921 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:30.149755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:30.149921 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:30.149885 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:30.220662 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:30.219581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" event={"ID":"b269e6e4157a42bf31cb36998ee3b9da","Type":"ContainerStarted","Data":"c442274be5d758cc17de193a305bb257d369e5a75bd6fd04c598f57b816bd55e"} Jul 23 13:28:31.149025 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:31.148986 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:31.149518 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.149123 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:31.780928 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:31.780884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:31.781127 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:31.780948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:31.781127 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.781026 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:31.781127 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.781089 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:31.781127 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.781111 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:35.781088183 +0000 UTC m=+10.088466026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:31.781360 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.781145 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:35.781127676 +0000 UTC m=+10.088505536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:31.882141 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:31.882080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:31.882328 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.882271 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:31.882328 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.882292 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:31.882328 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.882306 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:31.882491 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:31.882368 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:35.882349662 +0000 UTC m=+10.189727512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:32.149313 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:32.149234 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:32.149313 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:32.149289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:32.149845 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:32.149375 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:32.149845 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:32.149579 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:33.149500 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:33.148964 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:33.149500 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:33.149121 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:34.149578 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:34.149029 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:34.149578 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:34.149181 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:34.150154 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:34.149682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:34.150154 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:34.149801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:35.149387 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:35.149342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:35.149601 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.149501 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:35.817406 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:35.817365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:35.817644 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:35.817413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:35.817644 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.817539 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:35.817644 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.817539 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:35.817805 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.817616 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:43.817593023 +0000 UTC m=+18.124970885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:35.817805 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.817684 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:43.817663341 +0000 UTC m=+18.125041198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:35.918908 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:35.918871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:35.919081 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.919059 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:35.919081 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.919082 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:35.919261 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.919092 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:35.919261 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:35.919137 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:43.91912017 +0000 UTC m=+18.226498026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:36.149880 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:36.149793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:36.150304 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:36.149937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:36.154088 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:36.151376 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:36.154088 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:36.151552 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:37.148683 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:37.148652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:37.148845 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:37.148792 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:38.148737 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:38.148702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:38.149174 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:38.148838 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:38.149174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:38.149034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:38.149174 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:38.149123 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:39.148725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:39.148693 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:39.148928 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:39.148844 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:40.151899 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:40.151862 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:40.151899 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:40.151875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:40.152364 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:40.151968 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:40.152364 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:40.152109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:41.149181 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:41.149144 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:41.149353 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:41.149280 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:42.149117 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:42.149086 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:42.149117 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:42.149114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:42.149651 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:42.149209 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:42.149651 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:42.149350 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:43.148562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:43.148526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:43.148761 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.148658 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:43.880007 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:43.879974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:43.880007 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:43.880013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:43.880474 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.880135 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:43.880474 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.880137 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:43.880474 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.880191 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:59.880173269 +0000 UTC m=+34.187551111 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:43.880474 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.880208 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:59.880199808 +0000 UTC m=+34.187577654 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:43.980723 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:43.980686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:43.980901 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.980856 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:28:43.980901 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.980877 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:28:43.980901 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.980892 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:43.981018 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:43.980955 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:28:59.980934202 +0000 UTC m=+34.288312042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:28:44.148806 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:44.148729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:44.148937 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:44.148842 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:44.148937 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:44.148890 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:44.149013 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:44.148978 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:45.148725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:45.148690 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:45.149163 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:45.148815 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:46.149944 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:46.149908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:46.150406 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:46.150015 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:46.150406 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:46.150063 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:46.150406 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:46.150173 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:47.148695 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:47.148660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:47.148877 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:47.148789 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:48.149352 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:48.149274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:48.149938 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:48.149413 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:48.149938 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:48.149484 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:48.149938 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:48.149613 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:49.149578 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.148928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:49.149578 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:49.149493 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:49.261348 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.261317 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" event={"ID":"bb35003e3a2089e3489c75f90e5d25fe","Type":"ContainerStarted","Data":"4edae3978f6cf5f8896ce382cc7b959568e7b9f0b04f42efe0189e514eabdd5d"} Jul 23 13:28:49.262801 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.262771 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" event={"ID":"1f52cde9-c7ee-4002-98dc-adab6c16ff42","Type":"ContainerStarted","Data":"328de9dc5a74bfea580313d7a90dae801ad3812397e9ee357af7501334a5a386"} Jul 23 13:28:49.264300 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.264276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" event={"ID":"75dd9272-c9cc-462b-9cd5-8c8c4f054df6","Type":"ContainerStarted","Data":"81e80c1672de2853a91d2f47e941dcb3a28d996706bdc06c9ac2e21f309d829b"} Jul 23 13:28:49.265714 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.265684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2v75" event={"ID":"199b62d0-5ee5-4dbf-90c8-6aa843c3cce1","Type":"ContainerStarted","Data":"c5a7384df5f2f878c9b36c850afa3b9a2487e5650bd11b00a7f0474c130358c3"} Jul 23 13:28:49.267039 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.267013 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="e3528c26dd6254e6db7de8e52a3341408d91dc5578f3c32ddcb1bd121528c8b9" exitCode=0 Jul 23 13:28:49.267129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.267081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"e3528c26dd6254e6db7de8e52a3341408d91dc5578f3c32ddcb1bd121528c8b9"} Jul 23 13:28:49.268469 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.268446 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xbzw" event={"ID":"a52c75d5-60a4-4087-8906-b9fc00c78c70","Type":"ContainerStarted","Data":"4e586daf3caa65c3c4a2b99033181653a6067706590e7e01e0bd7230d5bdc927"} Jul 23 13:28:49.271852 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"bc0ab395e1b2693c0a9fc123b6440cd01759d0e0caa560288e7b034218484c9f"} Jul 23 13:28:49.271852 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"5d95fd80da87f7e6690f041ea08f8eef502c5a94911306b4ca86ec1fd58e8418"} Jul 23 13:28:49.271995 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271887 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"45af03ba4e4db7e731a21b8b93e4616a70e04c8fc54a75c3fc5d21fa30d9337b"} Jul 23 13:28:49.271995 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271923 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"a4520a4ae3f7231227d0d9dcf746c4cb6821025923008d4e9b075d8668252cc0"} Jul 23 13:28:49.271995 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"34f475669e91b33b14b4be6c3354e00099d6e664fe6ec2fe9daddd7dbfbf3b20"} Jul 23 13:28:49.271995 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.271986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"09dbb85d3722a2e1a46e813f86285e2a4a99e6296f2ee95021bf184170943451"} Jul 23 13:28:49.273384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.273360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fbxln" event={"ID":"ef724c99-74b1-42d1-b1f5-8b0d7617218b","Type":"ContainerStarted","Data":"915030c0530643e6dab66de1872db50955282fbc0330c937e6e8ff6562245fd0"} Jul 23 13:28:49.274885 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.274864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlxx2" event={"ID":"1cbccaf9-6015-41b0-a84f-d9cb1ba8897d","Type":"ContainerStarted","Data":"8450fbcbb6b205c382dd5729e0a35eaac796087596cbd9650d01cbe5ea989c48"} Jul 23 13:28:49.289797 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.289753 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-209.ec2.internal" podStartSLOduration=22.289739325 podStartE2EDuration="22.289739325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:30.239798562 +0000 UTC m=+4.547176430" watchObservedRunningTime="2026-07-23 13:28:49.289739325 +0000 UTC m=+23.597117188" Jul 23 13:28:49.313914 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.313863 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-209.ec2.internal" podStartSLOduration=22.313849493 podStartE2EDuration="22.313849493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.29054025 +0000 UTC m=+23.597918109" watchObservedRunningTime="2026-07-23 13:28:49.313849493 +0000 UTC m=+23.621227356" Jul 23 13:28:49.329948 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.329895 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nh9mx" podStartSLOduration=2.4693916160000002 podStartE2EDuration="22.329876839s" totalImagesPullingTime="19.860485223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.313643703 +0000 UTC m=+23.621021565" watchObservedRunningTime="2026-07-23 13:28:49.329876839 +0000 UTC m=+23.637254702" Jul 23 13:28:49.352671 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.352614 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5xbzw" podStartSLOduration=2.4593030000000002 podStartE2EDuration="22.352594544s" totalImagesPullingTime="19.893291544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.329150598 +0000 UTC m=+23.636528461" watchObservedRunningTime="2026-07-23 13:28:49.352594544 +0000 UTC m=+23.659972407" Jul 23 13:28:49.367835 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.367795 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fbxln" podStartSLOduration=2.482974653 podStartE2EDuration="22.367782245s" totalImagesPullingTime="19.884807592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.367217203 +0000 UTC m=+23.674595067" watchObservedRunningTime="2026-07-23 13:28:49.367782245 +0000 UTC m=+23.675160109" Jul 23 13:28:49.386183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.386141 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jlxx2" podStartSLOduration=2.4443683959999998 podStartE2EDuration="22.386131193s" totalImagesPullingTime="19.941762797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.385865135 +0000 UTC m=+23.693242991" watchObservedRunningTime="2026-07-23 13:28:49.386131193 +0000 UTC m=+23.693509057" Jul 23 13:28:49.402078 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:49.402034 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2v75" podStartSLOduration=2.539932088 podStartE2EDuration="22.402016953s" totalImagesPullingTime="19.862084865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:49.401769862 +0000 UTC m=+23.709147756" watchObservedRunningTime="2026-07-23 13:28:49.402016953 +0000 UTC m=+23.709394816" Jul 23 13:28:50.148840 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:50.148759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:50.148840 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:50.148780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:50.149129 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:50.148885 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:50.149195 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:50.149169 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:50.279075 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:50.279034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vd7jb" event={"ID":"55d26310-2da8-44da-a416-abd9a03bec08","Type":"ContainerStarted","Data":"ff120c3a6e5f787911c537444cf45ddc2554168ea7c34734bba351a00862cd68"} Jul 23 13:28:50.295009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:50.294960 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vd7jb" podStartSLOduration=3.43314186 podStartE2EDuration="23.29493972s" totalImagesPullingTime="19.86179786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:50.294795256 +0000 UTC m=+24.602173129" watchObservedRunningTime="2026-07-23 13:28:50.29493972 +0000 UTC m=+24.602317584" Jul 23 13:28:50.486486 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:50.486463 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 13:28:51.104130 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:51.104032 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T13:28:50.486480634Z","UUID":"9f496cc1-bd84-4c59-8bda-5423dec94c08","Handler":null,"Name":"","Endpoint":""} Jul 23 13:28:51.105703 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:51.105680 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 13:28:51.105841 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:51.105726 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 13:28:51.148790 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:51.148757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:51.148939 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:51.148901 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:51.284051 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:51.284012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" event={"ID":"75dd9272-c9cc-462b-9cd5-8c8c4f054df6","Type":"ContainerStarted","Data":"9414317f917bc0df0ab4f73e18a204f58c89aeb05f340651b4d688ded27b63dd"} Jul 23 13:28:52.148935 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.148696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:52.149091 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.148750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:52.149091 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:52.148984 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:52.149091 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:52.149060 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:52.288126 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.288082 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" event={"ID":"75dd9272-c9cc-462b-9cd5-8c8c4f054df6","Type":"ContainerStarted","Data":"d4a795f7197351f264aeabf866d5435c3c506aa5da3155f1a479be7c4a4cfe83"} Jul 23 13:28:52.291656 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.291628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"c3b21b91c328159b2523a5d674ebbe66f420e6f256587025933627bd5af22369"} Jul 23 13:28:52.632582 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.632552 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:52.633361 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.633342 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:52.651094 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:52.651039 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jq52r" podStartSLOduration=3.894787021 podStartE2EDuration="26.651020272s" totalImagesPullingTime="22.756233251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:52.308194654 +0000 UTC m=+26.615572518" watchObservedRunningTime="2026-07-23 13:28:52.651020272 +0000 UTC m=+26.958398137" Jul 23 13:28:53.149176 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:53.149142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:53.149392 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:53.149278 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:53.294926 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:53.294887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:53.295391 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:53.295278 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fbxln" Jul 23 13:28:54.148553 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.148420 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:54.148553 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.148457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:54.148553 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:54.148536 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:54.148777 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:54.148596 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:54.297691 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.297656 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="e18ea23fff367e5068d09b8dce52a27100641c9e4b650bf4430940253eb6520b" exitCode=0 Jul 23 13:28:54.298425 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.297734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"e18ea23fff367e5068d09b8dce52a27100641c9e4b650bf4430940253eb6520b"} Jul 23 13:28:54.301616 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.301589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" event={"ID":"6e493d4b-f257-49b4-9e95-7a84bf95928a","Type":"ContainerStarted","Data":"be72c827f2ea85bedcdb61b31857804d2e93576d606d889cd53bcd750c406346"} Jul 23 13:28:54.351105 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:54.351047 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" podStartSLOduration=7.374455757 podStartE2EDuration="27.35103333s" totalImagesPullingTime="19.976577573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:28:54.349832943 +0000 UTC m=+28.657210838" watchObservedRunningTime="2026-07-23 13:28:54.35103333 +0000 UTC m=+28.658411193" Jul 23 13:28:55.149295 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.149265 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:55.149475 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:55.149379 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:55.305124 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.305092 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:55.305566 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.305179 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:55.305566 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.305231 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:55.320156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.320126 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:55.320296 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.320270 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:28:55.692703 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.692676 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74tzz"] Jul 23 13:28:55.692855 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.692808 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:55.692939 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:55.692917 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:55.694974 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.694921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zsddw"] Jul 23 13:28:55.695132 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.695041 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:55.695197 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:55.695159 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:55.695729 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.695697 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl7cf"] Jul 23 13:28:55.695822 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:55.695809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:55.695939 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:55.695915 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:56.309321 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:56.309285 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="01fd8fcb56a7ca7315fa39b0adb3d2bd73e91679a8825026a4b51471f889eb7b" exitCode=0 Jul 23 13:28:56.309902 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:56.309377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"01fd8fcb56a7ca7315fa39b0adb3d2bd73e91679a8825026a4b51471f889eb7b"} Jul 23 13:28:57.148773 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:57.148734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:57.148934 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:57.148734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:57.148934 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:57.148861 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:57.149005 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:57.148932 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:57.149005 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:57.148734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:57.149074 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:57.149010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:58.318106 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:58.317937 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="3e63749b5dfb3ef6803fe373f05d151706094b70426428bb53053d94fc57f969" exitCode=0 Jul 23 13:28:58.318520 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:58.318181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"3e63749b5dfb3ef6803fe373f05d151706094b70426428bb53053d94fc57f969"} Jul 23 13:28:59.148461 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:59.148422 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:28:59.148461 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:59.148470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:59.148722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:59.148437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:59.148722 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.148569 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:28:59.148722 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.148631 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:28:59.148722 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.148692 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:28:59.898923 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:59.898891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:28:59.898923 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:28:59.898926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:28:59.899320 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.899028 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:59.899320 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.899079 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret podName:b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:31.899065229 +0000 UTC m=+66.206443073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret") pod "global-pull-secret-syncer-xl7cf" (UID: "b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1") : object "kube-system"/"original-pull-secret" not registered Jul 23 13:28:59.899320 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.899091 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:28:59.899320 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:28:59.899134 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs podName:ca30a538-b7c1-4e4c-940e-7e8e16758427 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:31.899121793 +0000 UTC m=+66.206499638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs") pod "network-metrics-daemon-zsddw" (UID: "ca30a538-b7c1-4e4c-940e-7e8e16758427") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 13:29:00.000098 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:00.000008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:00.000244 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:00.000134 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 13:29:00.000244 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:00.000148 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 13:29:00.000244 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:00.000159 2559 projected.go:196] Error preparing data for projected volume kube-api-access-lxjkg for pod openshift-network-diagnostics/network-check-target-74tzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:29:00.000244 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:00.000207 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg podName:de58fa93-e762-42f4-9d7d-637324a85981 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:32.000193658 +0000 UTC m=+66.307571510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lxjkg" (UniqueName: "kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg") pod "network-check-target-74tzz" (UID: "de58fa93-e762-42f4-9d7d-637324a85981") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 13:29:01.148747 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.148712 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:29:01.148747 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.148745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:01.149402 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.148819 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:29:01.149402 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.148834 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xl7cf" podUID="b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1" Jul 23 13:29:01.149402 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.148891 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74tzz" podUID="de58fa93-e762-42f4-9d7d-637324a85981" Jul 23 13:29:01.149402 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.148960 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zsddw" podUID="ca30a538-b7c1-4e4c-940e-7e8e16758427" Jul 23 13:29:01.521635 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.521600 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-209.ec2.internal" event="NodeReady" Jul 23 13:29:01.521838 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.521824 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 13:29:01.564058 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.564028 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:29:01.565984 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.565968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.570098 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.570077 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ml2sn\"" Jul 23 13:29:01.571749 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.571718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 13:29:01.571749 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.571735 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 13:29:01.571749 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.571744 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 13:29:01.578831 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.578807 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 13:29:01.615520 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.615416 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx"] Jul 23 13:29:01.617889 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.617868 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-4zksx"] Jul 23 13:29:01.618036 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.617979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" Jul 23 13:29:01.620256 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.620232 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp"] Jul 23 13:29:01.620375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.620339 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.622847 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.622708 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh"] Jul 23 13:29:01.622847 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.622814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.623379 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.623360 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.624323 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.624295 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.625785 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.625033 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.626536 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9"] Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.626821 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.626952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.627388 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.627554 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 23 13:29:01.627775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.627481 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dn7cg\"" Jul 23 13:29:01.628094 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.627877 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.629442 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.629420 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw"] Jul 23 13:29:01.629673 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.629655 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.629870 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.629848 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 13:29:01.629962 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.629883 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zzkxv\"" Jul 23 13:29:01.630028 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.630012 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.631878 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.631862 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-667b94bf6b-psv2s"] Jul 23 13:29:01.631968 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.631953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.634412 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.634394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nn5fz"] Jul 23 13:29:01.634550 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.634527 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.637517 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.637481 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9cd67"] Jul 23 13:29:01.637598 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.637584 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.637987 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.637939 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.638763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.638742 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 13:29:01.638857 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.638780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 13:29:01.638857 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.638813 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.639002 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.638982 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqlgq\"" Jul 23 13:29:01.639100 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.639074 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-54snt\"" Jul 23 13:29:01.639192 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.639173 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.639460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.639445 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lppx6\"" Jul 23 13:29:01.640562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.640282 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx"] Jul 23 13:29:01.640562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.640316 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8"] Jul 23 13:29:01.640562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.640400 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.641945 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.641926 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 23 13:29:01.642046 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.641953 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.643175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.643151 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw"] Jul 23 13:29:01.643280 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.643196 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d"] Jul 23 13:29:01.644969 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.644312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" Jul 23 13:29:01.645208 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.645187 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 23 13:29:01.645715 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.645593 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.645715 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.645598 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 23 13:29:01.646014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.645938 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.646128 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.646074 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-4zksx"] Jul 23 13:29:01.646128 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.646104 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w22w6"] Jul 23 13:29:01.646272 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.646258 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.648032 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.648009 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.648455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.648351 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 13:29:01.648455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.648289 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.648984 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.648959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 13:29:01.650686 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.650663 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.654649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.651100 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 23 13:29:01.654649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.652540 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rx855\"" Jul 23 13:29:01.654649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.652566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f9r4s\"" Jul 23 13:29:01.654649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.653220 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.654892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.654849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.654947 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.654891 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 23 13:29:01.656422 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.650523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp"] Jul 23 13:29:01.656540 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.656492 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9"] Jul 23 13:29:01.657719 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.657697 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.657849 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.657832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 13:29:01.657946 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.657924 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 13:29:01.658049 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.657881 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.658104 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 23 13:29:01.658240 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658222 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 13:29:01.658397 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658377 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 13:29:01.658576 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658556 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 13:29:01.658696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658680 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vtmbr\"" Jul 23 13:29:01.658765 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658719 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 23 13:29:01.658932 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 23 13:29:01.659004 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.658990 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-69vpx\"" Jul 23 13:29:01.659055 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.659031 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 13:29:01.659185 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.659171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qg27f\"" Jul 23 13:29:01.659307 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.659290 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gdr5w\"" Jul 23 13:29:01.659374 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.659357 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bjd62\"" Jul 23 13:29:01.662409 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.662384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cd67"] Jul 23 13:29:01.663305 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.663284 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8"] Jul 23 13:29:01.664234 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.664217 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d"] Jul 23 13:29:01.665067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.665047 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 13:29:01.667448 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.667430 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 23 13:29:01.669933 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.669282 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 13:29:01.670458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.670440 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w22w6"] Jul 23 13:29:01.671463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.671442 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:29:01.676536 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.676495 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667b94bf6b-psv2s"] Jul 23 13:29:01.680813 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.680797 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nn5fz"] Jul 23 13:29:01.691526 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.691438 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh"] Jul 23 13:29:01.712430 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-snapshots\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.712638 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96ef5d24-3666-4d91-a28d-7b3d94c524ad-serving-cert\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.712766 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.712904 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.712991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnd6\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.712991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89006b5-00be-465c-af65-e92d0af22fbc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.712991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89006b5-00be-465c-af65-e92d0af22fbc-config\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.712991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.712985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md6ch\" (UniqueName: \"kubernetes.io/projected/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-kube-api-access-md6ch\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdqlp\" (UniqueName: \"kubernetes.io/projected/7076b2b8-7139-439e-83f9-8091f0ff61f5-kube-api-access-hdqlp\") pod \"volume-data-source-validator-78cf4c6f6-d7ktx\" (UID: \"7076b2b8-7139-439e-83f9-8091f0ff61f5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e8f0efd-de87-401e-a102-02814b8e3f8a-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.713183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsxmf\" (UniqueName: \"kubernetes.io/projected/96ef5d24-3666-4d91-a28d-7b3d94c524ad-kube-api-access-lsxmf\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngbm\" (UniqueName: \"kubernetes.io/projected/f89006b5-00be-465c-af65-e92d0af22fbc-kube-api-access-gngbm\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkdr2\" (UniqueName: \"kubernetes.io/projected/efc2ce98-c0e3-4361-91c1-d664542fea54-kube-api-access-gkdr2\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-service-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-tmp\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.713458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.714102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.714102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.714102 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.713645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzxx\" (UniqueName: \"kubernetes.io/projected/4e8f0efd-de87-401e-a102-02814b8e3f8a-kube-api-access-xxzxx\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.814434 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.814434 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.814434 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.814434 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814478 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60472c7-2c27-49bf-a8b6-a405f81ec481-cert\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-default-certificate\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-snapshots\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.814585 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.814607 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.814680 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.314659804 +0000 UTC m=+36.622037654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89006b5-00be-465c-af65-e92d0af22fbc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-trusted-ca\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.814789 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814789 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8rd\" (UniqueName: \"kubernetes.io/projected/55515c93-3a88-45fb-8024-7e0222aedba4-kube-api-access-sl8rd\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-tmp-dir\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnd6\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.814991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-config-volume\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md6ch\" (UniqueName: \"kubernetes.io/projected/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-kube-api-access-md6ch\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815087 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gjlj\" (UniqueName: \"kubernetes.io/projected/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-kube-api-access-7gjlj\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdqlp\" (UniqueName: \"kubernetes.io/projected/7076b2b8-7139-439e-83f9-8091f0ff61f5-kube-api-access-hdqlp\") pod \"volume-data-source-validator-78cf4c6f6-d7ktx\" (UID: \"7076b2b8-7139-439e-83f9-8091f0ff61f5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e8f0efd-de87-401e-a102-02814b8e3f8a-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.815431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815414 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngbm\" (UniqueName: \"kubernetes.io/projected/f89006b5-00be-465c-af65-e92d0af22fbc-kube-api-access-gngbm\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-service-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4wsr\" (UniqueName: \"kubernetes.io/projected/a60472c7-2c27-49bf-a8b6-a405f81ec481-kube-api-access-w4wsr\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-tmp\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815760 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-snapshots\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzxx\" (UniqueName: \"kubernetes.io/projected/4e8f0efd-de87-401e-a102-02814b8e3f8a-kube-api-access-xxzxx\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815860 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-config\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.815875 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/723df8ae-c3df-49cd-8544-4028f78dfa1a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815941 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96ef5d24-3666-4d91-a28d-7b3d94c524ad-serving-cert\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.815977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkdr2\" (UniqueName: \"kubernetes.io/projected/efc2ce98-c0e3-4361-91c1-d664542fea54-kube-api-access-gkdr2\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816031 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96ef5d24-3666-4d91-a28d-7b3d94c524ad-tmp\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89006b5-00be-465c-af65-e92d0af22fbc-config\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816042 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816115 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4e8f0efd-de87-401e-a102-02814b8e3f8a-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-stats-auth\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816126 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96ef5d24-3666-4d91-a28d-7b3d94c524ad-service-ca-bundle\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55515c93-3a88-45fb-8024-7e0222aedba4-serving-cert\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n75ng\" (UniqueName: \"kubernetes.io/projected/ea3e357d-6967-4084-938a-5e8ded4a2766-kube-api-access-n75ng\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.816562 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bsf\" (UniqueName: \"kubernetes.io/projected/32e611b2-b360-43d2-a042-9bdda881631c-kube-api-access-m9bsf\") pod \"network-check-source-7bc5b6bf85-h5tv8\" (UID: \"32e611b2-b360-43d2-a042-9bdda881631c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" Jul 23 13:29:01.817164 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.817164 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.817164 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.816307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsxmf\" (UniqueName: \"kubernetes.io/projected/96ef5d24-3666-4d91-a28d-7b3d94c524ad-kube-api-access-lsxmf\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.817164 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.817026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f89006b5-00be-465c-af65-e92d0af22fbc-config\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.817164 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.817126 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:01.817418 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.817188 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.317170901 +0000 UTC m=+36.624548742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:01.817418 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.817397 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:01.817610 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.817453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.317439004 +0000 UTC m=+36.624816846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:01.820043 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.819991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.820043 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.820010 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f89006b5-00be-465c-af65-e92d0af22fbc-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.820291 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.820268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.820399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.820268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.820399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.820340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/96ef5d24-3666-4d91-a28d-7b3d94c524ad-serving-cert\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.824646 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.824613 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md6ch\" (UniqueName: \"kubernetes.io/projected/3b3691aa-caa9-4972-9463-c8c5f97c6cb5-kube-api-access-md6ch\") pod \"kube-storage-version-migrator-operator-7658d9b749-njtbw\" (UID: \"3b3691aa-caa9-4972-9463-c8c5f97c6cb5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.825701 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.825677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnd6\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.827653 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.827611 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsxmf\" (UniqueName: \"kubernetes.io/projected/96ef5d24-3666-4d91-a28d-7b3d94c524ad-kube-api-access-lsxmf\") pod \"insights-operator-555d9d7885-4zksx\" (UID: \"96ef5d24-3666-4d91-a28d-7b3d94c524ad\") " pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.827799 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.827756 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzxx\" (UniqueName: \"kubernetes.io/projected/4e8f0efd-de87-401e-a102-02814b8e3f8a-kube-api-access-xxzxx\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:01.828301 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.827911 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngbm\" (UniqueName: \"kubernetes.io/projected/f89006b5-00be-465c-af65-e92d0af22fbc-kube-api-access-gngbm\") pod \"service-ca-operator-5bcbc94c78-qjmdh\" (UID: \"f89006b5-00be-465c-af65-e92d0af22fbc\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.828301 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.828136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:01.828446 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.828357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdqlp\" (UniqueName: \"kubernetes.io/projected/7076b2b8-7139-439e-83f9-8091f0ff61f5-kube-api-access-hdqlp\") pod \"volume-data-source-validator-78cf4c6f6-d7ktx\" (UID: \"7076b2b8-7139-439e-83f9-8091f0ff61f5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" Jul 23 13:29:01.829148 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.829105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkdr2\" (UniqueName: \"kubernetes.io/projected/efc2ce98-c0e3-4361-91c1-d664542fea54-kube-api-access-gkdr2\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:01.916849 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.916813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4wsr\" (UniqueName: \"kubernetes.io/projected/a60472c7-2c27-49bf-a8b6-a405f81ec481-kube-api-access-w4wsr\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.916880 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.916907 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-config\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.916935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/723df8ae-c3df-49cd-8544-4028f78dfa1a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.916963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917020 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-stats-auth\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.917057 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.917044 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55515c93-3a88-45fb-8024-7e0222aedba4-serving-cert\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n75ng\" (UniqueName: \"kubernetes.io/projected/ea3e357d-6967-4084-938a-5e8ded4a2766-kube-api-access-n75ng\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.917127 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.417105592 +0000 UTC m=+36.724483453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.917176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.417155194 +0000 UTC m=+36.724533039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bsf\" (UniqueName: \"kubernetes.io/projected/32e611b2-b360-43d2-a042-9bdda881631c-kube-api-access-m9bsf\") pod \"network-check-source-7bc5b6bf85-h5tv8\" (UID: \"32e611b2-b360-43d2-a042-9bdda881631c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60472c7-2c27-49bf-a8b6-a405f81ec481-cert\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-default-certificate\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.917433 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:01.917460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-trusted-ca\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917468 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8rd\" (UniqueName: \"kubernetes.io/projected/55515c93-3a88-45fb-8024-7e0222aedba4-kube-api-access-sl8rd\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.917476 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.417462841 +0000 UTC m=+36.724840682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-tmp-dir\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-config-volume\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gjlj\" (UniqueName: \"kubernetes.io/projected/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-kube-api-access-7gjlj\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.917961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.917806 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-config\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.918259 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.918160 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-tmp-dir\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.918259 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.918172 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:01.918259 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:01.918236 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:02.418219318 +0000 UTC m=+36.725597173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:01.918558 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.918444 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/723df8ae-c3df-49cd-8544-4028f78dfa1a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:01.918648 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.918635 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/55515c93-3a88-45fb-8024-7e0222aedba4-trusted-ca\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.918699 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.918667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-config-volume\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.920026 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.919956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55515c93-3a88-45fb-8024-7e0222aedba4-serving-cert\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.920644 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.920612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-default-certificate\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.920980 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.920960 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-stats-auth\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.921060 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.921040 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a60472c7-2c27-49bf-a8b6-a405f81ec481-cert\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.932162 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.932132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4wsr\" (UniqueName: \"kubernetes.io/projected/a60472c7-2c27-49bf-a8b6-a405f81ec481-kube-api-access-w4wsr\") pod \"ingress-canary-9cd67\" (UID: \"a60472c7-2c27-49bf-a8b6-a405f81ec481\") " pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:01.932470 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.932430 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8rd\" (UniqueName: \"kubernetes.io/projected/55515c93-3a88-45fb-8024-7e0222aedba4-kube-api-access-sl8rd\") pod \"console-operator-565b7b569d-nn5fz\" (UID: \"55515c93-3a88-45fb-8024-7e0222aedba4\") " pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:01.932868 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.932851 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gjlj\" (UniqueName: \"kubernetes.io/projected/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-kube-api-access-7gjlj\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:01.933024 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.933005 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n75ng\" (UniqueName: \"kubernetes.io/projected/ea3e357d-6967-4084-938a-5e8ded4a2766-kube-api-access-n75ng\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:01.933302 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.933285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bsf\" (UniqueName: \"kubernetes.io/projected/32e611b2-b360-43d2-a042-9bdda881631c-kube-api-access-m9bsf\") pod \"network-check-source-7bc5b6bf85-h5tv8\" (UID: \"32e611b2-b360-43d2-a042-9bdda881631c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" Jul 23 13:29:01.933964 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.933936 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" Jul 23 13:29:01.940900 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.940883 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-4zksx" Jul 23 13:29:01.962488 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.961538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" Jul 23 13:29:01.980763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.980730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" Jul 23 13:29:01.996095 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:01.996070 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:02.004978 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.004949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9cd67" Jul 23 13:29:02.010872 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.010775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" Jul 23 13:29:02.171558 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.171221 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-4zksx"] Jul 23 13:29:02.180581 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.180486 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ef5d24_3666_4d91_a28d_7b3d94c524ad.slice/crio-505bf84b33d21c0e6ad9300e70d3dda2764b565f9660fb75ac8a3da63d6d9abe WatchSource:0}: Error finding container 505bf84b33d21c0e6ad9300e70d3dda2764b565f9660fb75ac8a3da63d6d9abe: Status 404 returned error can't find the container with id 505bf84b33d21c0e6ad9300e70d3dda2764b565f9660fb75ac8a3da63d6d9abe Jul 23 13:29:02.198963 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.198921 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx"] Jul 23 13:29:02.206670 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.206351 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh"] Jul 23 13:29:02.209794 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.209760 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7076b2b8_7139_439e_83f9_8091f0ff61f5.slice/crio-e57a0428920d2a3571db3c8de03310b81dbf744b35ae872dc5efebb414f237a1 WatchSource:0}: Error finding container e57a0428920d2a3571db3c8de03310b81dbf744b35ae872dc5efebb414f237a1: Status 404 returned error can't find the container with id e57a0428920d2a3571db3c8de03310b81dbf744b35ae872dc5efebb414f237a1 Jul 23 13:29:02.211210 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.211179 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89006b5_00be_465c_af65_e92d0af22fbc.slice/crio-43c4f5e272cf79465f76e5a2d9e2ee15a11d303c126c4cde6c6dc7a14929c375 WatchSource:0}: Error finding container 43c4f5e272cf79465f76e5a2d9e2ee15a11d303c126c4cde6c6dc7a14929c375: Status 404 returned error can't find the container with id 43c4f5e272cf79465f76e5a2d9e2ee15a11d303c126c4cde6c6dc7a14929c375 Jul 23 13:29:02.246915 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.246884 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw"] Jul 23 13:29:02.250372 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.250341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3691aa_caa9_4972_9463_c8c5f97c6cb5.slice/crio-32036b14aa0d19e2b2970edd5c427dcaa96a613c70b72f08d05ceae41c725176 WatchSource:0}: Error finding container 32036b14aa0d19e2b2970edd5c427dcaa96a613c70b72f08d05ceae41c725176: Status 404 returned error can't find the container with id 32036b14aa0d19e2b2970edd5c427dcaa96a613c70b72f08d05ceae41c725176 Jul 23 13:29:02.263711 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.263667 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-nn5fz"] Jul 23 13:29:02.280490 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.280462 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9cd67"] Jul 23 13:29:02.284153 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.284113 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60472c7_2c27_49bf_a8b6_a405f81ec481.slice/crio-4c4ba5921f466ec780cde2b784fd0638084e1c9b7f113b14daa3207577333dc8 WatchSource:0}: Error finding container 4c4ba5921f466ec780cde2b784fd0638084e1c9b7f113b14daa3207577333dc8: Status 404 returned error can't find the container with id 4c4ba5921f466ec780cde2b784fd0638084e1c9b7f113b14daa3207577333dc8 Jul 23 13:29:02.285132 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.285114 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8"] Jul 23 13:29:02.288351 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:02.288277 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e611b2_b360_43d2_a042_9bdda881631c.slice/crio-4465feb8e7620ba8aabb9c658db7ad2bb4bb80d5feea0b52f9c0619eb99f5766 WatchSource:0}: Error finding container 4465feb8e7620ba8aabb9c658db7ad2bb4bb80d5feea0b52f9c0619eb99f5766: Status 404 returned error can't find the container with id 4465feb8e7620ba8aabb9c658db7ad2bb4bb80d5feea0b52f9c0619eb99f5766 Jul 23 13:29:02.322449 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.322378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:02.322611 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.322465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:02.322611 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.322559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:02.322743 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322726 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:02.322794 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322746 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:02.322794 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322746 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:02.322794 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322767 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:02.322925 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322857 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.32278219 +0000 UTC m=+37.630160045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:02.322925 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322906 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.322867038 +0000 UTC m=+37.630244892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:02.323005 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.322928 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.322914254 +0000 UTC m=+37.630292095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:02.332197 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.332140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" event={"ID":"55515c93-3a88-45fb-8024-7e0222aedba4","Type":"ContainerStarted","Data":"d29fb779a50b2d19d144883719c261d75d24cb14c677e5f6b6374e6989fcf684"} Jul 23 13:29:02.333436 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.333409 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" event={"ID":"3b3691aa-caa9-4972-9463-c8c5f97c6cb5","Type":"ContainerStarted","Data":"32036b14aa0d19e2b2970edd5c427dcaa96a613c70b72f08d05ceae41c725176"} Jul 23 13:29:02.334785 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.334759 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" event={"ID":"f89006b5-00be-465c-af65-e92d0af22fbc","Type":"ContainerStarted","Data":"43c4f5e272cf79465f76e5a2d9e2ee15a11d303c126c4cde6c6dc7a14929c375"} Jul 23 13:29:02.335850 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.335830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-4zksx" event={"ID":"96ef5d24-3666-4d91-a28d-7b3d94c524ad","Type":"ContainerStarted","Data":"505bf84b33d21c0e6ad9300e70d3dda2764b565f9660fb75ac8a3da63d6d9abe"} Jul 23 13:29:02.336916 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.336882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" event={"ID":"7076b2b8-7139-439e-83f9-8091f0ff61f5","Type":"ContainerStarted","Data":"e57a0428920d2a3571db3c8de03310b81dbf744b35ae872dc5efebb414f237a1"} Jul 23 13:29:02.338127 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.338108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cd67" event={"ID":"a60472c7-2c27-49bf-a8b6-a405f81ec481","Type":"ContainerStarted","Data":"4c4ba5921f466ec780cde2b784fd0638084e1c9b7f113b14daa3207577333dc8"} Jul 23 13:29:02.339154 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.339134 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" event={"ID":"32e611b2-b360-43d2-a042-9bdda881631c","Type":"ContainerStarted","Data":"4465feb8e7620ba8aabb9c658db7ad2bb4bb80d5feea0b52f9c0619eb99f5766"} Jul 23 13:29:02.424072 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.424033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:02.424266 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.424082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:02.424266 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.424134 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:02.424266 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:02.424172 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424227 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424278 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424300 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424312 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.424290583 +0000 UTC m=+37.731668429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424339 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.424322935 +0000 UTC m=+37.731700792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424354 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.424347919 +0000 UTC m=+37.731725761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:02.424417 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:02.424364 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:03.424358456 +0000 UTC m=+37.731736297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:03.150466 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.149249 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:29:03.150466 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.149751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:29:03.150466 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.150185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:03.157000 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.156771 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 13:29:03.157843 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.157414 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 13:29:03.157843 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.157586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9lwl\"" Jul 23 13:29:03.157843 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.157675 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvbmz\"" Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.335457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.335571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.335664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.335833 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.335849 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.335906 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.33588571 +0000 UTC m=+39.643263557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.336326 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.336376 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.336361134 +0000 UTC m=+39.643738980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.336468 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:03.337050 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.336519 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.336491392 +0000 UTC m=+39.643869239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.436585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.436633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.436693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:03.436741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.436935 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.436994 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.436976208 +0000 UTC m=+39.744354060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.437220 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.437286 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.437265008 +0000 UTC m=+39.744642856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:03.437400 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.437344 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:03.437965 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.437426 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.437403799 +0000 UTC m=+39.744781642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:03.437965 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:03.437452 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:05.437441884 +0000 UTC m=+39.744819729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:05.355535 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.355483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:05.355987 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.355588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:05.355987 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.355666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:05.355987 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.355884 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:05.355987 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.355899 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:05.355987 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.355953 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.355935334 +0000 UTC m=+43.663313183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:05.356230 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.356019 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:05.356230 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.356053 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.356041773 +0000 UTC m=+43.663419614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:05.356230 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.356105 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:05.356230 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.356136 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.356125539 +0000 UTC m=+43.663503386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.458972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.459037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.459180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:05.459221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.459343 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.459402 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.459384706 +0000 UTC m=+43.766762549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.459850 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.459835131 +0000 UTC m=+43.767212972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.459932 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.459965 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.459954352 +0000 UTC m=+43.767332193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.460014 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:05.460206 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:05.460047 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:09.460035968 +0000 UTC m=+43.767413814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:09.396110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.396008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.396130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396187 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396261 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.396246238 +0000 UTC m=+51.703624091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396277 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.396298 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396318 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.396305659 +0000 UTC m=+51.703683503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396364 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:09.396574 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.396411 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.396398765 +0000 UTC m=+51.703776605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:09.497195 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.497162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:09.497195 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.497201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.497236 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:09.497266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497323 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497391 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.49737566 +0000 UTC m=+51.804753504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497399 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:09.497428 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497328 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:09.497682 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497411 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.497401233 +0000 UTC m=+51.804779080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:09.497682 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497488 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.497468783 +0000 UTC m=+51.804846638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:09.497682 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:09.497527 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:17.497516679 +0000 UTC m=+51.804894526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:11.372109 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.371825 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" event={"ID":"55515c93-3a88-45fb-8024-7e0222aedba4","Type":"ContainerStarted","Data":"53ffb0b1a1138c821e76e817d9b186eba770d81995b2295986de83fb572233a6"} Jul 23 13:29:11.372109 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.372046 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:11.373447 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.373336 2559 patch_prober.go:28] interesting pod/console-operator-565b7b569d-nn5fz container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jul 23 13:29:11.373447 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.373383 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jul 23 13:29:11.374097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.374072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" event={"ID":"3b3691aa-caa9-4972-9463-c8c5f97c6cb5","Type":"ContainerStarted","Data":"697b3709507f9a744464b14fa137f74781ab1e253c76fc82e37b29ae04a8785f"} Jul 23 13:29:11.376061 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.376039 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" event={"ID":"f89006b5-00be-465c-af65-e92d0af22fbc","Type":"ContainerStarted","Data":"de40afa724e52a3ba1a98fef00045b24eb7206a5e1db106a33555ad224e94c43"} Jul 23 13:29:11.379410 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.379385 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-4zksx" event={"ID":"96ef5d24-3666-4d91-a28d-7b3d94c524ad","Type":"ContainerStarted","Data":"38b8892b16a6d8f16abadc129452bc681ece0e25baa5b271b53800c22480f82e"} Jul 23 13:29:11.383153 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.383128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" event={"ID":"7076b2b8-7139-439e-83f9-8091f0ff61f5","Type":"ContainerStarted","Data":"be2255bd38a763643dbf76250b5ff9e50cff15b7317a0beb87640fd3d7579b05"} Jul 23 13:29:11.385056 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.385035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9cd67" event={"ID":"a60472c7-2c27-49bf-a8b6-a405f81ec481","Type":"ContainerStarted","Data":"0ff7eabd2e274561ab898267b899dd260c008259f25b0e488aa68e3dc6f691bb"} Jul 23 13:29:11.386920 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.386874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" event={"ID":"32e611b2-b360-43d2-a042-9bdda881631c","Type":"ContainerStarted","Data":"b4020cc7b042769b2876a74663a1a69ca8f04d1ea60de01a5ef907b603710201"} Jul 23 13:29:11.390105 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.390081 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="b8967349cc5bc8a1de58477daa0addf2d7e3bffcbe550be002957f7999df78e6" exitCode=0 Jul 23 13:29:11.390200 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.390115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"b8967349cc5bc8a1de58477daa0addf2d7e3bffcbe550be002957f7999df78e6"} Jul 23 13:29:11.452595 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.452529 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podStartSLOduration=28.645860666 podStartE2EDuration="37.452490196s" totalImagesPullingTime="8.80662953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.415173505 +0000 UTC m=+45.722551367" watchObservedRunningTime="2026-07-23 13:29:11.452490196 +0000 UTC m=+45.759868040" Jul 23 13:29:11.482133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.481197 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-d7ktx" podStartSLOduration=28.633133622 podStartE2EDuration="37.481178064s" totalImagesPullingTime="8.848044442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.479063196 +0000 UTC m=+45.786441052" watchObservedRunningTime="2026-07-23 13:29:11.481178064 +0000 UTC m=+45.788555907" Jul 23 13:29:11.505077 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.504999 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" podStartSLOduration=28.641232284 podStartE2EDuration="37.504976592s" totalImagesPullingTime="8.863744308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.504913106 +0000 UTC m=+45.812290973" watchObservedRunningTime="2026-07-23 13:29:11.504976592 +0000 UTC m=+45.812354456" Jul 23 13:29:11.590668 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.590616 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h5tv8" podStartSLOduration=28.791599704 podStartE2EDuration="37.590598966s" totalImagesPullingTime="8.798999262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.549872845 +0000 UTC m=+45.857250709" watchObservedRunningTime="2026-07-23 13:29:11.590598966 +0000 UTC m=+45.897976830" Jul 23 13:29:11.591309 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.591282 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-4zksx" podStartSLOduration=28.699383666 podStartE2EDuration="37.591275498s" totalImagesPullingTime="8.891891832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.587416336 +0000 UTC m=+45.894794218" watchObservedRunningTime="2026-07-23 13:29:11.591275498 +0000 UTC m=+45.898653418" Jul 23 13:29:11.627245 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.627188 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" podStartSLOduration=29.16823532 podStartE2EDuration="37.627167269s" totalImagesPullingTime="8.458931949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.626461664 +0000 UTC m=+45.933839529" watchObservedRunningTime="2026-07-23 13:29:11.627167269 +0000 UTC m=+45.934545114" Jul 23 13:29:11.997348 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.997300 2559 patch_prober.go:28] interesting pod/console-operator-565b7b569d-nn5fz container/console-operator namespace/openshift-console-operator: Liveness probe status=failure output="Get \"https://10.132.0.12:8443/healthz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body= Jul 23 13:29:11.997572 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:11.997361 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/healthz\": dial tcp 10.132.0.12:8443: connect: connection refused" Jul 23 13:29:12.397177 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.397096 2559 generic.go:356] "Generic (PLEG): container finished" podID="ee4c17db-1d7b-4409-a34b-e575cbdc4ea6" containerID="f144ddcfe89fd6eb0070f6bd9c5d0a1af4e47070be9d3bde0ea3c18e34e759ae" exitCode=0 Jul 23 13:29:12.397736 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.397704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerDied","Data":"f144ddcfe89fd6eb0070f6bd9c5d0a1af4e47070be9d3bde0ea3c18e34e759ae"} Jul 23 13:29:12.401179 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.401158 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/0.log" Jul 23 13:29:12.401337 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.401308 2559 generic.go:356] "Generic (PLEG): container finished" podID="55515c93-3a88-45fb-8024-7e0222aedba4" containerID="53ffb0b1a1138c821e76e817d9b186eba770d81995b2295986de83fb572233a6" exitCode=255 Jul 23 13:29:12.401597 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.401570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" event={"ID":"55515c93-3a88-45fb-8024-7e0222aedba4","Type":"ContainerDied","Data":"53ffb0b1a1138c821e76e817d9b186eba770d81995b2295986de83fb572233a6"} Jul 23 13:29:12.401683 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.401662 2559 scope.go:117] "RemoveContainer" containerID="53ffb0b1a1138c821e76e817d9b186eba770d81995b2295986de83fb572233a6" Jul 23 13:29:12.429414 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.429343 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9cd67" podStartSLOduration=2.636013115 podStartE2EDuration="11.429325006s" totalImagesPullingTime="8.793311891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:11.651623656 +0000 UTC m=+45.959001499" watchObservedRunningTime="2026-07-23 13:29:12.429325006 +0000 UTC m=+46.736702870" Jul 23 13:29:12.446697 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.446674 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6c258"] Jul 23 13:29:12.486748 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.486725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.487763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.487737 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c258"] Jul 23 13:29:12.497115 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.496968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b48h2\"" Jul 23 13:29:12.497473 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.497454 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 13:29:12.498031 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.498012 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 13:29:12.532455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.532367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86vwf\" (UniqueName: \"kubernetes.io/projected/158c4331-933f-4f86-8e37-155888ca4228-kube-api-access-86vwf\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.532667 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.532645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/158c4331-933f-4f86-8e37-155888ca4228-data-volume\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.532736 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.532709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/158c4331-933f-4f86-8e37-155888ca4228-crio-socket\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.532797 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.532765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.532848 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.532793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.633865 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.633831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/158c4331-933f-4f86-8e37-155888ca4228-data-volume\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.633982 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.633879 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/158c4331-933f-4f86-8e37-155888ca4228-crio-socket\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.633982 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.633923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.633982 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.633950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.634139 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.634067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86vwf\" (UniqueName: \"kubernetes.io/projected/158c4331-933f-4f86-8e37-155888ca4228-kube-api-access-86vwf\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.634271 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/158c4331-933f-4f86-8e37-155888ca4228-crio-socket\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:12.634476 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:12.634563 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:13.134537379 +0000 UTC m=+47.441915238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : configmap "kube-rbac-proxy" not found Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.634600 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/158c4331-933f-4f86-8e37-155888ca4228-data-volume\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:12.634693 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:12.634761 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:12.634738 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:13.134722119 +0000 UTC m=+47.442099960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:12.652921 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:12.652856 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86vwf\" (UniqueName: \"kubernetes.io/projected/158c4331-933f-4f86-8e37-155888ca4228-kube-api-access-86vwf\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:13.139028 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.138985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:13.139210 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.139037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:13.139210 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:13.139118 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 13:29:13.139210 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:13.139194 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:14.13917501 +0000 UTC m=+48.446552866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : configmap "kube-rbac-proxy" not found Jul 23 13:29:13.139210 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:13.139197 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:13.139441 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:13.139252 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:14.139234733 +0000 UTC m=+48.446612588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:13.408076 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.407987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" event={"ID":"ee4c17db-1d7b-4409-a34b-e575cbdc4ea6","Type":"ContainerStarted","Data":"94cc8917e63e847fb65e4ea32cfc41b2db4fd95c736abe2aa976836cc069644b"} Jul 23 13:29:13.409456 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.409439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:29:13.409795 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.409782 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/0.log" Jul 23 13:29:13.409842 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.409811 2559 generic.go:356] "Generic (PLEG): container finished" podID="55515c93-3a88-45fb-8024-7e0222aedba4" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" exitCode=255 Jul 23 13:29:13.409878 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.409860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" event={"ID":"55515c93-3a88-45fb-8024-7e0222aedba4","Type":"ContainerDied","Data":"ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca"} Jul 23 13:29:13.409911 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.409898 2559 scope.go:117] "RemoveContainer" containerID="53ffb0b1a1138c821e76e817d9b186eba770d81995b2295986de83fb572233a6" Jul 23 13:29:13.410060 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.410039 2559 scope.go:117] "RemoveContainer" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" Jul 23 13:29:13.410214 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:13.410195 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nn5fz_openshift-console-operator(55515c93-3a88-45fb-8024-7e0222aedba4)\"" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" Jul 23 13:29:13.449141 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:13.449099 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j8lxf" podStartSLOduration=8.426893507 podStartE2EDuration="47.449086394s" totalImagesPullingTime="39.022192887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:13.443241666 +0000 UTC m=+47.750619529" watchObservedRunningTime="2026-07-23 13:29:13.449086394 +0000 UTC m=+47.756464235" Jul 23 13:29:14.149186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:14.149153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:14.149186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:14.149191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:14.149408 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:14.149292 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 13:29:14.149408 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:14.149317 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:14.149408 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:14.149364 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:16.149346146 +0000 UTC m=+50.456724004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : configmap "kube-rbac-proxy" not found Jul 23 13:29:14.149408 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:14.149380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:16.149373916 +0000 UTC m=+50.456751761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:14.353399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:14.353375 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xbzw_a52c75d5-60a4-4087-8906-b9fc00c78c70/dns-node-resolver/0.log" Jul 23 13:29:14.415550 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:14.415458 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:29:14.415891 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:14.415832 2559 scope.go:117] "RemoveContainer" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" Jul 23 13:29:14.416013 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:14.415992 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nn5fz_openshift-console-operator(55515c93-3a88-45fb-8024-7e0222aedba4)\"" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" Jul 23 13:29:15.753785 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:15.753755 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2v75_199b62d0-5ee5-4dbf-90c8-6aa843c3cce1/node-ca/0.log" Jul 23 13:29:16.155990 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:16.155914 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cd67_a60472c7-2c27-49bf-a8b6-a405f81ec481/serve-healthcheck-canary/0.log" Jul 23 13:29:16.168553 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:16.168527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:16.168677 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:16.168555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:16.168677 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:16.168647 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 13:29:16.168764 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:16.168678 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:16.168764 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:16.168712 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:20.168695067 +0000 UTC m=+54.476072932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : configmap "kube-rbac-proxy" not found Jul 23 13:29:16.168764 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:16.168732 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:20.16872515 +0000 UTC m=+54.476102990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:17.480707 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.480664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.480758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.480815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480816 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480835 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc5cf8577-t62qj: secret "image-registry-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480894 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls podName:c1ce1128-6731-46b7-98bb-4cf71373dc62 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.480873589 +0000 UTC m=+67.788251460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls") pod "image-registry-7cc5cf8577-t62qj" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62") : secret "image-registry-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480935 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480949 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.480991 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls podName:4e8f0efd-de87-401e-a102-02814b8e3f8a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.480977807 +0000 UTC m=+67.788355652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-qq9s9" (UID: "4e8f0efd-de87-401e-a102-02814b8e3f8a") : secret "cluster-monitoring-operator-tls" not found Jul 23 13:29:17.481103 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.481007 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls podName:efc2ce98-c0e3-4361-91c1-d664542fea54 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.48100024 +0000 UTC m=+67.788378080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-29jgp" (UID: "efc2ce98-c0e3-4361-91c1-d664542fea54") : secret "samples-operator-tls" not found Jul 23 13:29:17.581584 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.581551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:17.581726 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.581587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:17.581726 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.581654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:17.581726 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:17.581683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:17.581833 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581757 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 13:29:17.581833 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581791 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.581774419 +0000 UTC m=+67.889152277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : configmap references non-existent config key: service-ca.crt Jul 23 13:29:17.581833 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581812 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs podName:ea3e357d-6967-4084-938a-5e8ded4a2766 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.581802372 +0000 UTC m=+67.889180216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs") pod "router-default-667b94bf6b-psv2s" (UID: "ea3e357d-6967-4084-938a-5e8ded4a2766") : secret "router-metrics-certs-default" not found Jul 23 13:29:17.581833 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581779 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 13:29:17.581990 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581841 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls podName:32ac3642-3f9f-49c6-bc0f-94ff4596f96d nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.581835735 +0000 UTC m=+67.889213576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls") pod "dns-default-w22w6" (UID: "32ac3642-3f9f-49c6-bc0f-94ff4596f96d") : secret "dns-default-metrics-tls" not found Jul 23 13:29:17.581990 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581841 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 13:29:17.581990 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:17.581900 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert podName:723df8ae-c3df-49cd-8544-4028f78dfa1a nodeName:}" failed. No retries permitted until 2026-07-23 13:29:33.581884817 +0000 UTC m=+67.889262658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-6gv7d" (UID: "723df8ae-c3df-49cd-8544-4028f78dfa1a") : secret "networking-console-plugin-cert" not found Jul 23 13:29:20.207233 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:20.207195 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:20.207233 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:20.207233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:20.207878 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:20.207321 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 13:29:20.207878 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:20.207390 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:20.207878 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:20.207409 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:28.207387405 +0000 UTC m=+62.514765251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : configmap "kube-rbac-proxy" not found Jul 23 13:29:20.207878 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:20.207431 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:28.20741989 +0000 UTC m=+62.514797732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:21.372366 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:21.372331 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:21.372786 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:21.372737 2559 scope.go:117] "RemoveContainer" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" Jul 23 13:29:21.372901 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:21.372877 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nn5fz_openshift-console-operator(55515c93-3a88-45fb-8024-7e0222aedba4)\"" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" Jul 23 13:29:21.997003 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:21.996965 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:21.997330 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:21.997316 2559 scope.go:117] "RemoveContainer" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" Jul 23 13:29:21.997494 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:21.997475 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-nn5fz_openshift-console-operator(55515c93-3a88-45fb-8024-7e0222aedba4)\"" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" podUID="55515c93-3a88-45fb-8024-7e0222aedba4" Jul 23 13:29:27.322156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:27.322127 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wc7f2" Jul 23 13:29:28.279965 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:28.279923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:28.279965 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:28.279968 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:28.280293 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:28.280207 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 13:29:28.280293 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:28.280287 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls podName:158c4331-933f-4f86-8e37-155888ca4228 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:44.280265937 +0000 UTC m=+78.587643791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6c258" (UID: "158c4331-933f-4f86-8e37-155888ca4228") : secret "insights-runtime-extractor-tls" not found Jul 23 13:29:28.280555 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:28.280533 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/158c4331-933f-4f86-8e37-155888ca4228-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:31.913967 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.913928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:29:31.914411 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.913976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:29:31.916564 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.916545 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 13:29:31.917013 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.916998 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 13:29:31.926604 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.926579 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1-original-pull-secret\") pod \"global-pull-secret-syncer-xl7cf\" (UID: \"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1\") " pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:29:31.926604 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.926605 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca30a538-b7c1-4e4c-940e-7e8e16758427-metrics-certs\") pod \"network-metrics-daemon-zsddw\" (UID: \"ca30a538-b7c1-4e4c-940e-7e8e16758427\") " pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:29:31.965780 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.965757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xl7cf" Jul 23 13:29:31.977649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.977629 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9lwl\"" Jul 23 13:29:31.985865 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:31.985843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zsddw" Jul 23 13:29:32.014948 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.014864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:32.018865 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.018835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxjkg\" (UniqueName: \"kubernetes.io/projected/de58fa93-e762-42f4-9d7d-637324a85981-kube-api-access-lxjkg\") pod \"network-check-target-74tzz\" (UID: \"de58fa93-e762-42f4-9d7d-637324a85981\") " pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:32.102965 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.102941 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xl7cf"] Jul 23 13:29:32.105362 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:32.105337 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f1cee3_3d69_411b_b9a2_d68ceb2f0dc1.slice/crio-034d6668ec2c23146be9790e9d81e1afd7ae5737d6d58dccee88ce7bfa1dd3f8 WatchSource:0}: Error finding container 034d6668ec2c23146be9790e9d81e1afd7ae5737d6d58dccee88ce7bfa1dd3f8: Status 404 returned error can't find the container with id 034d6668ec2c23146be9790e9d81e1afd7ae5737d6d58dccee88ce7bfa1dd3f8 Jul 23 13:29:32.122741 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.122721 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zsddw"] Jul 23 13:29:32.129057 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:32.129033 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca30a538_b7c1_4e4c_940e_7e8e16758427.slice/crio-d2fa578b04fdb9d1f6ea27f7a4cc6f7b9dc6839bda61639c0c65b73fa4ee24cb WatchSource:0}: Error finding container d2fa578b04fdb9d1f6ea27f7a4cc6f7b9dc6839bda61639c0c65b73fa4ee24cb: Status 404 returned error can't find the container with id d2fa578b04fdb9d1f6ea27f7a4cc6f7b9dc6839bda61639c0c65b73fa4ee24cb Jul 23 13:29:32.285929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.285896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hvbmz\"" Jul 23 13:29:32.294804 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.294781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:32.415494 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.415464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74tzz"] Jul 23 13:29:32.418835 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:32.418807 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde58fa93_e762_42f4_9d7d_637324a85981.slice/crio-342d32c3e68cc79d1cb80d3b65f3a22523d3393466e2b6c3cb0da4f5ebfdfa69 WatchSource:0}: Error finding container 342d32c3e68cc79d1cb80d3b65f3a22523d3393466e2b6c3cb0da4f5ebfdfa69: Status 404 returned error can't find the container with id 342d32c3e68cc79d1cb80d3b65f3a22523d3393466e2b6c3cb0da4f5ebfdfa69 Jul 23 13:29:32.477849 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.477818 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl7cf" event={"ID":"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1","Type":"ContainerStarted","Data":"034d6668ec2c23146be9790e9d81e1afd7ae5737d6d58dccee88ce7bfa1dd3f8"} Jul 23 13:29:32.479029 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.478992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zsddw" event={"ID":"ca30a538-b7c1-4e4c-940e-7e8e16758427","Type":"ContainerStarted","Data":"d2fa578b04fdb9d1f6ea27f7a4cc6f7b9dc6839bda61639c0c65b73fa4ee24cb"} Jul 23 13:29:32.480333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.480312 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74tzz" event={"ID":"de58fa93-e762-42f4-9d7d-637324a85981","Type":"ContainerStarted","Data":"342d32c3e68cc79d1cb80d3b65f3a22523d3393466e2b6c3cb0da4f5ebfdfa69"} Jul 23 13:29:32.480438 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.480427 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:29:32.500431 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:32.500377 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-74tzz" podStartSLOduration=65.500360077 podStartE2EDuration="1m5.500360077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:32.4993275 +0000 UTC m=+66.806705365" watchObservedRunningTime="2026-07-23 13:29:32.500360077 +0000 UTC m=+66.807737940" Jul 23 13:29:33.486073 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.486035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74tzz" event={"ID":"de58fa93-e762-42f4-9d7d-637324a85981","Type":"ContainerStarted","Data":"17a83d1a7747b5a3cf2bcb2b28024dedb307242388c89e99ab93ba64a7f5e172"} Jul 23 13:29:33.488137 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.488103 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zsddw" event={"ID":"ca30a538-b7c1-4e4c-940e-7e8e16758427","Type":"ContainerStarted","Data":"9129fce1da50c88e328ce887a72ffffbcb383dba2879f68451f609b8fff1271a"} Jul 23 13:29:33.488271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.488148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zsddw" event={"ID":"ca30a538-b7c1-4e4c-940e-7e8e16758427","Type":"ContainerStarted","Data":"3f9cf189a0e35421d2f16524201028d22e157678e033e004e321f702000c58f3"} Jul 23 13:29:33.505810 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.505757 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zsddw" podStartSLOduration=65.500311874 podStartE2EDuration="1m6.505737489s" totalImagesPullingTime="1.005425615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:33.505003268 +0000 UTC m=+67.812381150" watchObservedRunningTime="2026-07-23 13:29:33.505737489 +0000 UTC m=+67.813115353" Jul 23 13:29:33.529658 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.529628 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:33.529776 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.529728 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:33.529853 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.529798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:33.532517 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.532473 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e8f0efd-de87-401e-a102-02814b8e3f8a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-qq9s9\" (UID: \"4e8f0efd-de87-401e-a102-02814b8e3f8a\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:33.532627 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.532597 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"image-registry-7cc5cf8577-t62qj\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:33.532684 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.532663 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efc2ce98-c0e3-4361-91c1-d664542fea54-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-29jgp\" (UID: \"efc2ce98-c0e3-4361-91c1-d664542fea54\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:33.630909 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.630867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:33.631092 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.630917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:33.631092 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.630950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:33.631092 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.630985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:33.631779 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.631749 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea3e357d-6967-4084-938a-5e8ded4a2766-service-ca-bundle\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:33.633731 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.633703 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/32ac3642-3f9f-49c6-bc0f-94ff4596f96d-metrics-tls\") pod \"dns-default-w22w6\" (UID: \"32ac3642-3f9f-49c6-bc0f-94ff4596f96d\") " pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:33.633832 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.633803 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/723df8ae-c3df-49cd-8544-4028f78dfa1a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6gv7d\" (UID: \"723df8ae-c3df-49cd-8544-4028f78dfa1a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:33.633881 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.633808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea3e357d-6967-4084-938a-5e8ded4a2766-metrics-certs\") pod \"router-default-667b94bf6b-psv2s\" (UID: \"ea3e357d-6967-4084-938a-5e8ded4a2766\") " pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:33.682131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.682101 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ml2sn\"" Jul 23 13:29:33.690303 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.690268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:33.755295 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.755264 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hqlgq\"" Jul 23 13:29:33.763211 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.763187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" Jul 23 13:29:33.775240 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.775218 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lppx6\"" Jul 23 13:29:33.783391 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.783367 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" Jul 23 13:29:33.790918 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.790893 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vtmbr\"" Jul 23 13:29:33.799194 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.799166 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:33.820224 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.820196 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qg27f\"" Jul 23 13:29:33.827861 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.827637 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" Jul 23 13:29:33.827861 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.827794 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bjd62\"" Jul 23 13:29:33.836666 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.836447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:33.851885 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.851861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:29:33.862398 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:33.862362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ce1128_6731_46b7_98bb_4cf71373dc62.slice/crio-5504142c1877d2e4af50dcd4876659c8e06e2aa5fe189a600e7daf5e65ea89b3 WatchSource:0}: Error finding container 5504142c1877d2e4af50dcd4876659c8e06e2aa5fe189a600e7daf5e65ea89b3: Status 404 returned error can't find the container with id 5504142c1877d2e4af50dcd4876659c8e06e2aa5fe189a600e7daf5e65ea89b3 Jul 23 13:29:33.973114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:33.973082 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp"] Jul 23 13:29:34.031159 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.031123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9"] Jul 23 13:29:34.074681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.074534 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-667b94bf6b-psv2s"] Jul 23 13:29:34.078986 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.078535 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d"] Jul 23 13:29:34.078986 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:34.078840 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3e357d_6967_4084_938a_5e8ded4a2766.slice/crio-0cc39a67857bcfc00e2214bebc61f5c1bb1618d1ef513a44d92ca49341527561 WatchSource:0}: Error finding container 0cc39a67857bcfc00e2214bebc61f5c1bb1618d1ef513a44d92ca49341527561: Status 404 returned error can't find the container with id 0cc39a67857bcfc00e2214bebc61f5c1bb1618d1ef513a44d92ca49341527561 Jul 23 13:29:34.084267 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:34.084203 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723df8ae_c3df_49cd_8544_4028f78dfa1a.slice/crio-eb42aa53cfcb57812911f18a622e03652b0ed8b210d2a6618640c3401d0ad04e WatchSource:0}: Error finding container eb42aa53cfcb57812911f18a622e03652b0ed8b210d2a6618640c3401d0ad04e: Status 404 returned error can't find the container with id eb42aa53cfcb57812911f18a622e03652b0ed8b210d2a6618640c3401d0ad04e Jul 23 13:29:34.104770 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.104750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w22w6"] Jul 23 13:29:34.111882 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:34.111843 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32ac3642_3f9f_49c6_bc0f_94ff4596f96d.slice/crio-2ef6125dd0851717c846c36716bf3b94b3aa6ce9b9fd53711968c2027eceef9a WatchSource:0}: Error finding container 2ef6125dd0851717c846c36716bf3b94b3aa6ce9b9fd53711968c2027eceef9a: Status 404 returned error can't find the container with id 2ef6125dd0851717c846c36716bf3b94b3aa6ce9b9fd53711968c2027eceef9a Jul 23 13:29:34.496708 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.496669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" event={"ID":"723df8ae-c3df-49cd-8544-4028f78dfa1a","Type":"ContainerStarted","Data":"eb42aa53cfcb57812911f18a622e03652b0ed8b210d2a6618640c3401d0ad04e"} Jul 23 13:29:34.498488 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.498461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" event={"ID":"4e8f0efd-de87-401e-a102-02814b8e3f8a","Type":"ContainerStarted","Data":"768155eeb3311ae9d754991f9503d76b300f09c2ecc9778ab8ffd47289715793"} Jul 23 13:29:34.500193 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.500165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" event={"ID":"efc2ce98-c0e3-4361-91c1-d664542fea54","Type":"ContainerStarted","Data":"068ada53830eb923428c4be72c9db59f43573f8e637bd85c58e35056fb61b5cc"} Jul 23 13:29:34.503923 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.503857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" event={"ID":"c1ce1128-6731-46b7-98bb-4cf71373dc62","Type":"ContainerStarted","Data":"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf"} Jul 23 13:29:34.504025 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.503980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" event={"ID":"c1ce1128-6731-46b7-98bb-4cf71373dc62","Type":"ContainerStarted","Data":"5504142c1877d2e4af50dcd4876659c8e06e2aa5fe189a600e7daf5e65ea89b3"} Jul 23 13:29:34.504999 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.504975 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:34.508187 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.508114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22w6" event={"ID":"32ac3642-3f9f-49c6-bc0f-94ff4596f96d","Type":"ContainerStarted","Data":"2ef6125dd0851717c846c36716bf3b94b3aa6ce9b9fd53711968c2027eceef9a"} Jul 23 13:29:34.511592 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.511558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667b94bf6b-psv2s" event={"ID":"ea3e357d-6967-4084-938a-5e8ded4a2766","Type":"ContainerStarted","Data":"347e091e1ac1ab534345c913c7e403968492895754642f8d7db3bd97aba1ce90"} Jul 23 13:29:34.511700 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.511607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-667b94bf6b-psv2s" event={"ID":"ea3e357d-6967-4084-938a-5e8ded4a2766","Type":"ContainerStarted","Data":"0cc39a67857bcfc00e2214bebc61f5c1bb1618d1ef513a44d92ca49341527561"} Jul 23 13:29:34.555025 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.554651 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-667b94bf6b-psv2s" podStartSLOduration=60.554631065 podStartE2EDuration="1m0.554631065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:34.553929526 +0000 UTC m=+68.861307392" watchObservedRunningTime="2026-07-23 13:29:34.554631065 +0000 UTC m=+68.862008930" Jul 23 13:29:34.555632 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.555594 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" podStartSLOduration=67.55558515 podStartE2EDuration="1m7.55558515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:34.532809524 +0000 UTC m=+68.840187390" watchObservedRunningTime="2026-07-23 13:29:34.55558515 +0000 UTC m=+68.862963012" Jul 23 13:29:34.799741 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.799654 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:34.803085 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:34.803059 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:35.149059 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:35.148976 2559 scope.go:117] "RemoveContainer" containerID="ff8cfea9267cc7c8c3e9a0439fd3124ef93143725dc290ffdfe36480c723bfca" Jul 23 13:29:35.515917 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:35.515844 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:35.517428 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:35.517380 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-667b94bf6b-psv2s" Jul 23 13:29:39.530904 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.530864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" event={"ID":"723df8ae-c3df-49cd-8544-4028f78dfa1a","Type":"ContainerStarted","Data":"92f56e8cb7a30fe91c112ad212ef0d915f148019ee3089d143e95796df030f8b"} Jul 23 13:29:39.532407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.532379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" event={"ID":"4e8f0efd-de87-401e-a102-02814b8e3f8a","Type":"ContainerStarted","Data":"d17b7ed000817c240d0f3313993a2323346ba542e17171c89d1e4e5c1e5253b4"} Jul 23 13:29:39.534306 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.534266 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" event={"ID":"efc2ce98-c0e3-4361-91c1-d664542fea54","Type":"ContainerStarted","Data":"0e854fde34d70a0e3575c34f2a36832d5a6cdc9f283c9e0102f3d0b722ffe311"} Jul 23 13:29:39.534424 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.534318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" event={"ID":"efc2ce98-c0e3-4361-91c1-d664542fea54","Type":"ContainerStarted","Data":"6e9696c05354962762e9148657b857e7470218c5d821557cb30fbdba556f6d07"} Jul 23 13:29:39.536110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.536093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:29:39.536214 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.536185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" event={"ID":"55515c93-3a88-45fb-8024-7e0222aedba4","Type":"ContainerStarted","Data":"37635e3401b3af619b28e491126e908996bb80188f410088b6659281f067dafb"} Jul 23 13:29:39.536464 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.536442 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:39.538176 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.538156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22w6" event={"ID":"32ac3642-3f9f-49c6-bc0f-94ff4596f96d","Type":"ContainerStarted","Data":"82fb52a86fe12fd98fe3f7cf2bede9cb36bf0b3831ea94270de8c2827fb10947"} Jul 23 13:29:39.538251 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.538190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22w6" event={"ID":"32ac3642-3f9f-49c6-bc0f-94ff4596f96d","Type":"ContainerStarted","Data":"7afe5a117a2484ac3ee606ef458c733058c4900ab38774ae5923a1d0f3e53cd0"} Jul 23 13:29:39.538251 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.538212 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:39.539716 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.539691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xl7cf" event={"ID":"b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1","Type":"ContainerStarted","Data":"e60eb8a65cbe8c99781762fefbadb7a49724c98e3d7f1400323b80eec9537661"} Jul 23 13:29:39.550879 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.550822 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6gv7d" podStartSLOduration=36.90821523 podStartE2EDuration="41.550806245s" totalImagesPullingTime="4.642591015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:39.550087468 +0000 UTC m=+73.857465335" watchObservedRunningTime="2026-07-23 13:29:39.550806245 +0000 UTC m=+73.858184109" Jul 23 13:29:39.571706 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.571663 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-29jgp" podStartSLOduration=60.900420955 podStartE2EDuration="1m5.571649205s" totalImagesPullingTime="4.67122825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:39.571303411 +0000 UTC m=+73.878681274" watchObservedRunningTime="2026-07-23 13:29:39.571649205 +0000 UTC m=+73.879027068" Jul 23 13:29:39.610912 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.610859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w22w6" podStartSLOduration=33.996653505 podStartE2EDuration="38.610843164s" totalImagesPullingTime="4.614189659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:39.609816834 +0000 UTC m=+73.917194724" watchObservedRunningTime="2026-07-23 13:29:39.610843164 +0000 UTC m=+73.918221026" Jul 23 13:29:39.625723 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.625661 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xl7cf" podStartSLOduration=66.00475309 podStartE2EDuration="1m12.6256426s" totalImagesPullingTime="6.62088951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:39.625431003 +0000 UTC m=+73.932808868" watchObservedRunningTime="2026-07-23 13:29:39.6256426 +0000 UTC m=+73.933020467" Jul 23 13:29:39.647186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.647145 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-qq9s9" podStartSLOduration=60.957512615 podStartE2EDuration="1m5.647130622s" totalImagesPullingTime="4.689618007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:39.645850022 +0000 UTC m=+73.953227885" watchObservedRunningTime="2026-07-23 13:29:39.647130622 +0000 UTC m=+73.954508485" Jul 23 13:29:39.861568 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:39.861477 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-nn5fz" Jul 23 13:29:44.322923 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:44.322881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:44.325304 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:44.325277 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/158c4331-933f-4f86-8e37-155888ca4228-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6c258\" (UID: \"158c4331-933f-4f86-8e37-155888ca4228\") " pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:44.617583 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:44.617478 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b48h2\"" Jul 23 13:29:44.625437 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:44.625412 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6c258" Jul 23 13:29:44.784071 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:44.784039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6c258"] Jul 23 13:29:44.786923 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:44.786894 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158c4331_933f_4f86_8e37_155888ca4228.slice/crio-aae9612665d01d31ff4207060e4bb7576261dff5e2482bd216b6f798605ab749 WatchSource:0}: Error finding container aae9612665d01d31ff4207060e4bb7576261dff5e2482bd216b6f798605ab749: Status 404 returned error can't find the container with id aae9612665d01d31ff4207060e4bb7576261dff5e2482bd216b6f798605ab749 Jul 23 13:29:45.563844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:45.563800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c258" event={"ID":"158c4331-933f-4f86-8e37-155888ca4228","Type":"ContainerStarted","Data":"aae9612665d01d31ff4207060e4bb7576261dff5e2482bd216b6f798605ab749"} Jul 23 13:29:49.545674 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:49.545540 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w22w6" Jul 23 13:29:50.572018 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.571980 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:29:50.575636 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.575614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.579057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.578966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 13:29:50.579057 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579025 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 13:29:50.579264 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 13:29:50.579333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579289 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jbkjf\"" Jul 23 13:29:50.579594 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579555 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 13:29:50.579762 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579746 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 13:29:50.579839 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579766 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 13:29:50.580010 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.579996 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 13:29:50.587549 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.587480 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:29:50.589005 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.588980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c258" event={"ID":"158c4331-933f-4f86-8e37-155888ca4228","Type":"ContainerStarted","Data":"a8b4b28c88128f74bd74da53e3ed6061f8c56b02881b9b36243931938fa86e3e"} Jul 23 13:29:50.675217 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675180 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.675394 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.675394 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62cz\" (UniqueName: \"kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.675394 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.675394 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.675394 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.675388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776554 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.776929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.776861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62cz\" (UniqueName: \"kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.777375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.777348 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.777521 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.777381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.777521 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.777402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.779685 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.779660 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.779785 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.779690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.786248 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.786221 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62cz\" (UniqueName: \"kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz\") pod \"console-fbff9785d-k895n\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:50.889536 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:50.889432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:29:51.040685 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:51.040651 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:29:51.043128 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:51.043099 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b52c88_2e50_4076_bc50_cce048ddfd8a.slice/crio-21ec9604f53ed6b35ce55e8c04c7192f67c73245abf9159946e813829ca65a9a WatchSource:0}: Error finding container 21ec9604f53ed6b35ce55e8c04c7192f67c73245abf9159946e813829ca65a9a: Status 404 returned error can't find the container with id 21ec9604f53ed6b35ce55e8c04c7192f67c73245abf9159946e813829ca65a9a Jul 23 13:29:51.594218 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:51.594179 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbff9785d-k895n" event={"ID":"e3b52c88-2e50-4076-bc50-cce048ddfd8a","Type":"ContainerStarted","Data":"21ec9604f53ed6b35ce55e8c04c7192f67c73245abf9159946e813829ca65a9a"} Jul 23 13:29:53.606516 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:53.606475 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c258" event={"ID":"158c4331-933f-4f86-8e37-155888ca4228","Type":"ContainerStarted","Data":"0f38c098bab281df2392cfc52fd8c47ed358691c25192025b9e17912111daedc"} Jul 23 13:29:54.945171 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.944805 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sqjv5"] Jul 23 13:29:54.949926 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.949900 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:54.952331 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.952301 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 13:29:54.952674 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.952643 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zvmz\"" Jul 23 13:29:54.952674 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.952673 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 13:29:54.952843 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.952796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 13:29:54.953007 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:54.952988 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-wtmp\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014403 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-root\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014448 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-metrics-client-ca\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwlf9\" (UniqueName: \"kubernetes.io/projected/c555759b-51f5-4ab8-a1c3-7b1382632a64-kube-api-access-gwlf9\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.014573 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-sys\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.015068 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-textfile\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.015068 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.014696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.115902 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.115859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-metrics-client-ca\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.115928 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwlf9\" (UniqueName: \"kubernetes.io/projected/c555759b-51f5-4ab8-a1c3-7b1382632a64-kube-api-access-gwlf9\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.115962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-sys\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.115998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-textfile\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-wtmp\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-root\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116399 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-root\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.116663 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:55.116636 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 23 13:29:55.116726 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:55.116718 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls podName:c555759b-51f5-4ab8-a1c3-7b1382632a64 nodeName:}" failed. No retries permitted until 2026-07-23 13:29:55.616695376 +0000 UTC m=+89.924073218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls") pod "node-exporter-sqjv5" (UID: "c555759b-51f5-4ab8-a1c3-7b1382632a64") : secret "node-exporter-tls" not found Jul 23 13:29:55.116946 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.116644 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-wtmp\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.117022 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.117003 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c555759b-51f5-4ab8-a1c3-7b1382632a64-sys\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.117615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.117555 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-textfile\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.117713 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.117682 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-accelerators-collector-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.117961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.117940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c555759b-51f5-4ab8-a1c3-7b1382632a64-metrics-client-ca\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.119535 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.119494 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.125812 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.125765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwlf9\" (UniqueName: \"kubernetes.io/projected/c555759b-51f5-4ab8-a1c3-7b1382632a64-kube-api-access-gwlf9\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.621904 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.621869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.624833 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.624802 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c555759b-51f5-4ab8-a1c3-7b1382632a64-node-exporter-tls\") pod \"node-exporter-sqjv5\" (UID: \"c555759b-51f5-4ab8-a1c3-7b1382632a64\") " pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.862773 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.862733 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sqjv5" Jul 23 13:29:55.942215 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.942136 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:29:55.966686 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.966579 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:29:55.967127 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.966701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:55.969745 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969569 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 13:29:55.969745 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969596 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 13:29:55.969745 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969613 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 13:29:55.969986 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969787 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 13:29:55.969986 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969902 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kvcrg\"" Jul 23 13:29:55.969986 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969940 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 13:29:55.969986 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.969968 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 13:29:55.970166 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.970097 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 13:29:55.970166 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.970105 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 13:29:55.970256 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:55.970186 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 13:29:56.025561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025977 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025977 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmm5t\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025977 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025977 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.025977 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.025934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.026236 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.026027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.026236 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.026066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127113 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:56.127207 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle podName:51e8fb95-f086-45f1-b086-a7f1e5cedbff nodeName:}" failed. No retries permitted until 2026-07-23 13:29:56.627182706 +0000 UTC m=+90.934560561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff") : configmap references non-existent config key: ca-bundle.crt Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:56.127271 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 23 13:29:56.127312 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127284 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:56.127327 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls podName:51e8fb95-f086-45f1-b086-a7f1e5cedbff nodeName:}" failed. No retries permitted until 2026-07-23 13:29:56.627310965 +0000 UTC m=+90.934688809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff") : secret "alertmanager-main-tls" not found Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmm5t\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.127681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.128040 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.128040 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.127732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.128271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.128247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.130396 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.130372 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.130483 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.130402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.130483 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.130428 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.130696 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.130675 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.131649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.131609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.131742 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.131672 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.132293 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.132258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.132489 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.132467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.133847 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.133805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.136331 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.136309 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmm5t\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.522859 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.522825 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:29:56.632599 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.632556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.632779 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.632695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.633593 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.633564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.635596 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.635571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:56.878474 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:56.878380 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:29:57.348040 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:57.347976 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc555759b_51f5_4ab8_a1c3_7b1382632a64.slice/crio-556f29f0d17dd540aabc672cb7b04ef99e0fb16d49173b407633853226963c7f WatchSource:0}: Error finding container 556f29f0d17dd540aabc672cb7b04ef99e0fb16d49173b407633853226963c7f: Status 404 returned error can't find the container with id 556f29f0d17dd540aabc672cb7b04ef99e0fb16d49173b407633853226963c7f Jul 23 13:29:57.496476 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.496433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:29:57.496616 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:57.496548 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e8fb95_f086_45f1_b086_a7f1e5cedbff.slice/crio-912148af369f2ba455b08b99f7e2a3c956425e491d21e92b8f987d76aa773231 WatchSource:0}: Error finding container 912148af369f2ba455b08b99f7e2a3c956425e491d21e92b8f987d76aa773231: Status 404 returned error can't find the container with id 912148af369f2ba455b08b99f7e2a3c956425e491d21e92b8f987d76aa773231 Jul 23 13:29:57.626946 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.626866 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6c258" event={"ID":"158c4331-933f-4f86-8e37-155888ca4228","Type":"ContainerStarted","Data":"25b84da4aac750e9bd0401108512dad5217da7bfa0df62c9e2c64366179cd863"} Jul 23 13:29:57.628129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.628099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"912148af369f2ba455b08b99f7e2a3c956425e491d21e92b8f987d76aa773231"} Jul 23 13:29:57.629257 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.629235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqjv5" event={"ID":"c555759b-51f5-4ab8-a1c3-7b1382632a64","Type":"ContainerStarted","Data":"556f29f0d17dd540aabc672cb7b04ef99e0fb16d49173b407633853226963c7f"} Jul 23 13:29:57.630668 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.630646 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbff9785d-k895n" event={"ID":"e3b52c88-2e50-4076-bc50-cce048ddfd8a","Type":"ContainerStarted","Data":"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e"} Jul 23 13:29:57.646983 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.646945 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6c258" podStartSLOduration=33.215372485 podStartE2EDuration="45.646932144s" totalImagesPullingTime="12.431559659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:29:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:57.646031129 +0000 UTC m=+91.953408993" watchObservedRunningTime="2026-07-23 13:29:57.646932144 +0000 UTC m=+91.954310006" Jul 23 13:29:57.666924 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.666884 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbff9785d-k895n" podStartSLOduration=1.366741477 podStartE2EDuration="7.666871436s" totalImagesPullingTime="6.300129959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:57.66605595 +0000 UTC m=+91.973433812" watchObservedRunningTime="2026-07-23 13:29:57.666871436 +0000 UTC m=+91.974249298" Jul 23 13:29:57.852987 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.852954 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85b8d55584-c54gv"] Jul 23 13:29:57.857337 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.857230 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.860772 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.860749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tqc5t\"" Jul 23 13:29:57.861246 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861223 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 13:29:57.861333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 13:29:57.861333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bnn3lh9l0t7pf\"" Jul 23 13:29:57.861333 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861273 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 13:29:57.861476 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861462 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 13:29:57.861814 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.861796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 13:29:57.871180 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.871155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85b8d55584-c54gv"] Jul 23 13:29:57.945380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-grpc-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-metrics-client-ca\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:57.945615 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:57.945587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65cqx\" (UniqueName: \"kubernetes.io/projected/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-kube-api-access-65cqx\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046753 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046753 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-grpc-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046866 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-metrics-client-ca\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.046991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.046966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.047224 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.047036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65cqx\" (UniqueName: \"kubernetes.io/projected/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-kube-api-access-65cqx\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.047988 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.047956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-metrics-client-ca\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.049865 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.049833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.050053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.050023 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-grpc-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.050187 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.050167 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.050336 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.050311 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.050566 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.050547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-tls\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.051373 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.051357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.055985 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.055958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65cqx\" (UniqueName: \"kubernetes.io/projected/fa49ab5f-4a8c-4e1a-8779-69f26073ecca-kube-api-access-65cqx\") pod \"thanos-querier-85b8d55584-c54gv\" (UID: \"fa49ab5f-4a8c-4e1a-8779-69f26073ecca\") " pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.166286 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.166252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:29:58.318594 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.318566 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85b8d55584-c54gv"] Jul 23 13:29:58.589227 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:58.589055 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa49ab5f_4a8c_4e1a_8779_69f26073ecca.slice/crio-86b9ff6f3d74424cad80dae05cc060ce91b89aa0e4d19a59a980d9425c0c6283 WatchSource:0}: Error finding container 86b9ff6f3d74424cad80dae05cc060ce91b89aa0e4d19a59a980d9425c0c6283: Status 404 returned error can't find the container with id 86b9ff6f3d74424cad80dae05cc060ce91b89aa0e4d19a59a980d9425c0c6283 Jul 23 13:29:58.642336 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:58.642280 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"86b9ff6f3d74424cad80dae05cc060ce91b89aa0e4d19a59a980d9425c0c6283"} Jul 23 13:29:59.384810 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.384774 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f56d5bc56-4h5fs"] Jul 23 13:29:59.388071 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.388048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.391641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.391392 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-i96ckef5d7f4\"" Jul 23 13:29:59.391641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.391428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 13:29:59.391641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.391471 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 13:29:59.391641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.391401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jwm58\"" Jul 23 13:29:59.391641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.391556 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 13:29:59.397908 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.397885 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 13:29:59.408255 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.408225 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f56d5bc56-4h5fs"] Jul 23 13:29:59.458950 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.458916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-metrics-server-audit-profiles\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.458956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.458993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82af9775-e95d-413d-8284-889cd2b1e3ca-audit-log\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.459022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-client-certs\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.459048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6dnd\" (UniqueName: \"kubernetes.io/projected/82af9775-e95d-413d-8284-889cd2b1e3ca-kube-api-access-w6dnd\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.459107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-tls\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.459277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.459161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-client-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560407 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-metrics-server-audit-profiles\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82af9775-e95d-413d-8284-889cd2b1e3ca-audit-log\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-client-certs\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6dnd\" (UniqueName: \"kubernetes.io/projected/82af9775-e95d-413d-8284-889cd2b1e3ca-kube-api-access-w6dnd\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-tls\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.560624 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.560621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-client-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.561178 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.561139 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/82af9775-e95d-413d-8284-889cd2b1e3ca-audit-log\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.561342 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.561319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.561575 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.561531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/82af9775-e95d-413d-8284-889cd2b1e3ca-metrics-server-audit-profiles\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.563961 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.563935 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-client-ca-bundle\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.564086 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.564026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-client-certs\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.564086 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.564078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/82af9775-e95d-413d-8284-889cd2b1e3ca-secret-metrics-server-tls\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.570752 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.570727 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6dnd\" (UniqueName: \"kubernetes.io/projected/82af9775-e95d-413d-8284-889cd2b1e3ca-kube-api-access-w6dnd\") pod \"metrics-server-f56d5bc56-4h5fs\" (UID: \"82af9775-e95d-413d-8284-889cd2b1e3ca\") " pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.648819 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.648725 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250" exitCode=0 Jul 23 13:29:59.649284 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.648848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250"} Jul 23 13:29:59.651357 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.651332 2559 generic.go:356] "Generic (PLEG): container finished" podID="c555759b-51f5-4ab8-a1c3-7b1382632a64" containerID="06769c22dea94b4058de3cb3932cf729c473809a5d865957a4ed532a7c458292" exitCode=0 Jul 23 13:29:59.651460 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.651396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqjv5" event={"ID":"c555759b-51f5-4ab8-a1c3-7b1382632a64","Type":"ContainerDied","Data":"06769c22dea94b4058de3cb3932cf729c473809a5d865957a4ed532a7c458292"} Jul 23 13:29:59.698609 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.698558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:29:59.725964 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.725917 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:29:59.739702 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.739673 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd"] Jul 23 13:29:59.745229 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.745206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:29:59.748791 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.748770 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 13:29:59.748895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.748813 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ps8jr\"" Jul 23 13:29:59.757607 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.757363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd"] Jul 23 13:29:59.862905 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.862874 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f56d5bc56-4h5fs"] Jul 23 13:29:59.863214 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.863181 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv48x\" (UniqueName: \"kubernetes.io/projected/c485192c-da5d-468f-bf51-2f0d9cfd2da0-kube-api-access-nv48x\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:29:59.863334 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.863293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:29:59.867205 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:29:59.867169 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82af9775_e95d_413d_8284_889cd2b1e3ca.slice/crio-4e9288d124a4e367b2b24e32b9d28693d1f76c783dee3f210148af9219aa4fd4 WatchSource:0}: Error finding container 4e9288d124a4e367b2b24e32b9d28693d1f76c783dee3f210148af9219aa4fd4: Status 404 returned error can't find the container with id 4e9288d124a4e367b2b24e32b9d28693d1f76c783dee3f210148af9219aa4fd4 Jul 23 13:29:59.964309 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.964259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:29:59.964565 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.964314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv48x\" (UniqueName: \"kubernetes.io/projected/c485192c-da5d-468f-bf51-2f0d9cfd2da0-kube-api-access-nv48x\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:29:59.964565 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:59.964431 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 13:29:59.964565 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:29:59.964541 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert podName:c485192c-da5d-468f-bf51-2f0d9cfd2da0 nodeName:}" failed. No retries permitted until 2026-07-23 13:30:00.464519063 +0000 UTC m=+94.771896918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-8rcqd" (UID: "c485192c-da5d-468f-bf51-2f0d9cfd2da0") : secret "monitoring-plugin-cert" not found Jul 23 13:29:59.973963 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:29:59.973942 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv48x\" (UniqueName: \"kubernetes.io/projected/c485192c-da5d-468f-bf51-2f0d9cfd2da0-kube-api-access-nv48x\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:00.112401 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.112361 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-596ddf88-t6jbr"] Jul 23 13:30:00.116230 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.116209 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.119207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.118931 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 13:30:00.119207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.118946 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 13:30:00.119207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.119035 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 13:30:00.119397 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.119336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 13:30:00.119835 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.119814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j4mmq\"" Jul 23 13:30:00.121340 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.121318 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 13:30:00.125942 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.125909 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 13:30:00.142238 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.142210 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-596ddf88-t6jbr"] Jul 23 13:30:00.165376 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165560 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-metrics-client-ca\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165560 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzbvj\" (UniqueName: \"kubernetes.io/projected/8b31e47d-0308-4d4e-af60-c99130070775-kube-api-access-kzbvj\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165663 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-trusted-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-serving-certs-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165841 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.165841 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.165815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-federate-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.266874 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.266778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzbvj\" (UniqueName: \"kubernetes.io/projected/8b31e47d-0308-4d4e-af60-c99130070775-kube-api-access-kzbvj\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.266872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.266896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-trusted-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.266944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-serving-certs-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.266972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.267011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-federate-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.267051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267186 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.267107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-metrics-client-ca\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267953 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.267902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-trusted-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.267953 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.267915 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-serving-certs-ca-bundle\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.269219 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.269194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b31e47d-0308-4d4e-af60-c99130070775-metrics-client-ca\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.270094 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.270071 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.270207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.270184 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-telemeter-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.270474 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.270451 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-secret-telemeter-client\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.270644 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.270606 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b31e47d-0308-4d4e-af60-c99130070775-federate-client-tls\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.278811 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.278791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzbvj\" (UniqueName: \"kubernetes.io/projected/8b31e47d-0308-4d4e-af60-c99130070775-kube-api-access-kzbvj\") pod \"telemeter-client-596ddf88-t6jbr\" (UID: \"8b31e47d-0308-4d4e-af60-c99130070775\") " pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.428590 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.428554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" Jul 23 13:30:00.468753 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.468697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:00.471761 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.471736 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c485192c-da5d-468f-bf51-2f0d9cfd2da0-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-8rcqd\" (UID: \"c485192c-da5d-468f-bf51-2f0d9cfd2da0\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:00.657270 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.657202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqjv5" event={"ID":"c555759b-51f5-4ab8-a1c3-7b1382632a64","Type":"ContainerStarted","Data":"10d97b372cc65a09364bd8b05e109149675ca5f91b283ae9b140693730123f1b"} Jul 23 13:30:00.657705 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.657294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sqjv5" event={"ID":"c555759b-51f5-4ab8-a1c3-7b1382632a64","Type":"ContainerStarted","Data":"4d7570f82358f938868a23ff62fa9ce93ec1b9977615b0cc4defd6b2ac41d0ea"} Jul 23 13:30:00.658437 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.658415 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" event={"ID":"82af9775-e95d-413d-8284-889cd2b1e3ca","Type":"ContainerStarted","Data":"4e9288d124a4e367b2b24e32b9d28693d1f76c783dee3f210148af9219aa4fd4"} Jul 23 13:30:00.662005 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.661981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:00.679423 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.679374 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sqjv5" podStartSLOduration=5.087220055 podStartE2EDuration="6.679356434s" totalImagesPullingTime="1.529436352s" totalInitContainerRuntime="62.700027ms" isStatefulPod=true podCreationTimestamp="2026-07-23 13:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:00.677637045 +0000 UTC m=+94.985014926" watchObservedRunningTime="2026-07-23 13:30:00.679356434 +0000 UTC m=+94.986734333" Jul 23 13:30:00.816410 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.816379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-596ddf88-t6jbr"] Jul 23 13:30:00.817678 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:30:00.817649 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b31e47d_0308_4d4e_af60_c99130070775.slice/crio-0a021ae7833ed8f35b01e865c23792322d94b65c01ec09379f2ed802af157aed WatchSource:0}: Error finding container 0a021ae7833ed8f35b01e865c23792322d94b65c01ec09379f2ed802af157aed: Status 404 returned error can't find the container with id 0a021ae7833ed8f35b01e865c23792322d94b65c01ec09379f2ed802af157aed Jul 23 13:30:00.830348 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.830317 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd"] Jul 23 13:30:00.835206 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:30:00.835177 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc485192c_da5d_468f_bf51_2f0d9cfd2da0.slice/crio-96015c9b8ae8602f87395f49815c461f8d6b40b7831a9b5f274ea46477f315ea WatchSource:0}: Error finding container 96015c9b8ae8602f87395f49815c461f8d6b40b7831a9b5f274ea46477f315ea: Status 404 returned error can't find the container with id 96015c9b8ae8602f87395f49815c461f8d6b40b7831a9b5f274ea46477f315ea Jul 23 13:30:00.905526 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:00.904601 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:30:01.131350 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.131316 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:30:01.135647 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.135626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.137721 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.137694 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 13:30:01.138158 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138125 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lqzmz\"" Jul 23 13:30:01.138307 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138243 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 13:30:01.138623 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138562 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 13:30:01.138715 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 13:30:01.138778 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 13:30:01.138778 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138707 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 13:30:01.138880 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138712 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 13:30:01.138880 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.138672 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 13:30:01.139169 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.139147 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 13:30:01.139279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.139224 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9col1fqhj0umv\"" Jul 23 13:30:01.139581 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.139561 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 13:30:01.139695 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.139647 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 13:30:01.139998 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.139832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 13:30:01.140202 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.140177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 13:30:01.141736 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.141679 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 13:30:01.151248 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.151225 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:30:01.177570 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177570 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177547 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177587 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177635 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ht6\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.177764 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.177959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178063 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178451 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178451 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178451 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178451 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.178451 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.178213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279655 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279655 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279655 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279655 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279655 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.279929 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.279985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ht6\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.280314 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.282350 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.280679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.282350 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.281356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.282350 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.282048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.282350 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.282324 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.283474 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.283442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.285122 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.285095 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.285219 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.281358 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.285284 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.285211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.285781 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.285759 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.287349 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.287303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.288817 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.288571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.288817 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.288622 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.288817 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.288721 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.288817 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.288761 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.289275 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.289260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.289413 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.289394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.289793 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.289776 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.291164 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.291119 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.293093 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.293052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ht6\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6\") pod \"prometheus-k8s-0\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.447354 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.447270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:01.665362 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.665325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"0fc8e9fd29ef80121c28a6e0dd158d4c9d57a189cbafbff61c2dc759b32cf228"} Jul 23 13:30:01.665842 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.665404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"0e25f4ccad9e34a13d8d03eb6844b8057e0e487e597085eadeff68550f518694"} Jul 23 13:30:01.665842 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.665443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"57158df5617813a08e26361acf44fb3b6681c8b997dde4a53b5b0adb3d1def1d"} Jul 23 13:30:01.666779 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.666750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" event={"ID":"8b31e47d-0308-4d4e-af60-c99130070775","Type":"ContainerStarted","Data":"0a021ae7833ed8f35b01e865c23792322d94b65c01ec09379f2ed802af157aed"} Jul 23 13:30:01.669980 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:01.669602 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" event={"ID":"c485192c-da5d-468f-bf51-2f0d9cfd2da0","Type":"ContainerStarted","Data":"96015c9b8ae8602f87395f49815c461f8d6b40b7831a9b5f274ea46477f315ea"} Jul 23 13:30:02.329859 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.329800 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:30:02.678008 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.677893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" event={"ID":"82af9775-e95d-413d-8284-889cd2b1e3ca","Type":"ContainerStarted","Data":"96fa70da2189e75a0ca96ef29ca85ec273c4437ab02d14a9a84143df09c7c35a"} Jul 23 13:30:02.680253 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.680223 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" exitCode=0 Jul 23 13:30:02.680390 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.680343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} Jul 23 13:30:02.680466 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.680420 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"44570bf540ef2461f87bfeeba61ac6203c79d3f7e5210724033c0f408adf881c"} Jul 23 13:30:02.685081 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.685047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e"} Jul 23 13:30:02.685182 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.685113 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781"} Jul 23 13:30:02.685182 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.685156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a"} Jul 23 13:30:02.685292 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.685198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd"} Jul 23 13:30:02.696797 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:02.696754 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" podStartSLOduration=1.4011081490000001 podStartE2EDuration="3.696735257s" totalImagesPullingTime="2.295627108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:02.695118128 +0000 UTC m=+97.002496014" watchObservedRunningTime="2026-07-23 13:30:02.696735257 +0000 UTC m=+97.004113104" Jul 23 13:30:03.696698 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.696658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2"} Jul 23 13:30:03.697156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.696743 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerStarted","Data":"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9"} Jul 23 13:30:03.702022 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.701992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"cdb6da1c57895b7b9c9d71b1a668c29fbcb55dceceb14b799417e5c0b483a1cf"} Jul 23 13:30:03.703330 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.703301 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"a6d2763c231adf69e01f03956c0d90b985e3d25d58fdbb634ad4204768b08f71"} Jul 23 13:30:03.703480 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.703386 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:30:03.703559 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.703490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" event={"ID":"fa49ab5f-4a8c-4e1a-8779-69f26073ecca","Type":"ContainerStarted","Data":"d39038f85cf77edc8fc64230bc963e1d1881c24c7135fc163fca1d6ec8d0b0e4"} Jul 23 13:30:03.739529 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.739340 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.867118711 podStartE2EDuration="8.739318291s" totalImagesPullingTime="3.855973707s" totalInitContainerRuntime="16.225873ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:03.737034877 +0000 UTC m=+98.044412765" watchObservedRunningTime="2026-07-23 13:30:03.739318291 +0000 UTC m=+98.046696156" Jul 23 13:30:03.764067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:03.764010 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" podStartSLOduration=2.823740469 podStartE2EDuration="6.763997413s" totalImagesPullingTime="3.940256944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:03.762390726 +0000 UTC m=+98.069768590" watchObservedRunningTime="2026-07-23 13:30:03.763997413 +0000 UTC m=+98.071375309" Jul 23 13:30:04.513814 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.513779 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-74tzz" Jul 23 13:30:04.709089 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.709045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" event={"ID":"8b31e47d-0308-4d4e-af60-c99130070775","Type":"ContainerStarted","Data":"674a0240c317811b16e4d4ec34e8829fa87e58d74839515294c8a75c9b1dac17"} Jul 23 13:30:04.709542 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.709122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" event={"ID":"8b31e47d-0308-4d4e-af60-c99130070775","Type":"ContainerStarted","Data":"f52f14f6ccecb7e6da6f51161eb47851cfc18bc901aac699c65665f98d6eecc9"} Jul 23 13:30:04.709542 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.709156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" event={"ID":"8b31e47d-0308-4d4e-af60-c99130070775","Type":"ContainerStarted","Data":"2aced386179a681403dee9a1e7e5d50b070f65df9c91d0bf148ccec0044bc703"} Jul 23 13:30:04.710880 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.710852 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" event={"ID":"c485192c-da5d-468f-bf51-2f0d9cfd2da0","Type":"ContainerStarted","Data":"e5c9e8845ea4089ff0b22d7d7f35e32133d0bbeaf666efc5d51a25027b28c8bc"} Jul 23 13:30:04.711704 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.711657 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:04.717358 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.717337 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" Jul 23 13:30:04.737759 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.737703 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-596ddf88-t6jbr" podStartSLOduration=1.603331881 podStartE2EDuration="4.737682635s" totalImagesPullingTime="3.134350754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:04.73572792 +0000 UTC m=+99.043105784" watchObservedRunningTime="2026-07-23 13:30:04.737682635 +0000 UTC m=+99.045060500" Jul 23 13:30:04.754697 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.754626 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-8rcqd" podStartSLOduration=2.686074157 podStartE2EDuration="5.754612741s" totalImagesPullingTime="3.068538584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:04.754224872 +0000 UTC m=+99.061602738" watchObservedRunningTime="2026-07-23 13:30:04.754612741 +0000 UTC m=+99.061990604" Jul 23 13:30:04.812534 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:04.812434 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:30:06.726722 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} Jul 23 13:30:06.727156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} Jul 23 13:30:06.727156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} Jul 23 13:30:06.727156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} Jul 23 13:30:06.727156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} Jul 23 13:30:06.727156 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.726882 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerStarted","Data":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} Jul 23 13:30:06.761930 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:06.761877 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.134067807 podStartE2EDuration="5.761855642s" totalImagesPullingTime="3.589911593s" totalInitContainerRuntime="37.876242ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:30:06.759977817 +0000 UTC m=+101.067355682" watchObservedRunningTime="2026-07-23 13:30:06.761855642 +0000 UTC m=+101.069233506" Jul 23 13:30:09.716831 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:09.716803 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85b8d55584-c54gv" Jul 23 13:30:11.448190 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:11.448156 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:30:19.699036 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:19.698998 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:30:19.699626 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:19.699067 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:30:22.796737 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:22.796695 2559 generic.go:356] "Generic (PLEG): container finished" podID="96ef5d24-3666-4d91-a28d-7b3d94c524ad" containerID="38b8892b16a6d8f16abadc129452bc681ece0e25baa5b271b53800c22480f82e" exitCode=0 Jul 23 13:30:22.797114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:22.796767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-4zksx" event={"ID":"96ef5d24-3666-4d91-a28d-7b3d94c524ad","Type":"ContainerDied","Data":"38b8892b16a6d8f16abadc129452bc681ece0e25baa5b271b53800c22480f82e"} Jul 23 13:30:22.797114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:22.797106 2559 scope.go:117] "RemoveContainer" containerID="38b8892b16a6d8f16abadc129452bc681ece0e25baa5b271b53800c22480f82e" Jul 23 13:30:23.803606 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:23.803570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-4zksx" event={"ID":"96ef5d24-3666-4d91-a28d-7b3d94c524ad","Type":"ContainerStarted","Data":"48ba3b50c67836097dd81f5789e338b3bec5b95a9d1a89af7ca39db9d6827e35"} Jul 23 13:30:24.754220 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:24.754181 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fbff9785d-k895n" podUID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" containerName="console" containerID="cri-o://c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e" gracePeriod=15 Jul 23 13:30:25.005530 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.005446 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:30:25.115251 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115216 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d62cz\" (UniqueName: \"kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115420 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115258 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115420 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115332 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115420 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115354 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115420 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115381 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115420 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115407 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert\") pod \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\" (UID: \"e3b52c88-2e50-4076-bc50-cce048ddfd8a\") " Jul 23 13:30:25.115846 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115803 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config" (OuterVolumeSpecName: "console-config") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:30:25.115971 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115922 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:30:25.115971 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.115934 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:30:25.117756 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.117736 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz" (OuterVolumeSpecName: "kube-api-access-d62cz") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "kube-api-access-d62cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:30:25.117844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.117775 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:30:25.117844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.117796 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3b52c88-2e50-4076-bc50-cce048ddfd8a" (UID: "e3b52c88-2e50-4076-bc50-cce048ddfd8a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:30:25.216426 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216389 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-oauth-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.216426 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216420 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-serving-cert\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.216426 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216432 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-service-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.216738 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216442 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-oauth-serving-cert\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.216738 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216451 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d62cz\" (UniqueName: \"kubernetes.io/projected/e3b52c88-2e50-4076-bc50-cce048ddfd8a-kube-api-access-d62cz\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.216738 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.216460 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3b52c88-2e50-4076-bc50-cce048ddfd8a-console-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:25.813207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.813171 2559 generic.go:356] "Generic (PLEG): container finished" podID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" containerID="c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e" exitCode=0 Jul 23 13:30:25.813372 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.813226 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbff9785d-k895n" Jul 23 13:30:25.813372 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.813259 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbff9785d-k895n" event={"ID":"e3b52c88-2e50-4076-bc50-cce048ddfd8a","Type":"ContainerDied","Data":"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e"} Jul 23 13:30:25.813372 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.813305 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbff9785d-k895n" event={"ID":"e3b52c88-2e50-4076-bc50-cce048ddfd8a","Type":"ContainerDied","Data":"21ec9604f53ed6b35ce55e8c04c7192f67c73245abf9159946e813829ca65a9a"} Jul 23 13:30:25.813372 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.813325 2559 scope.go:117] "RemoveContainer" containerID="c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e" Jul 23 13:30:25.822839 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.822818 2559 scope.go:117] "RemoveContainer" containerID="c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e" Jul 23 13:30:25.823117 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:30:25.823095 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e\": container with ID starting with c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e not found: ID does not exist" containerID="c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e" Jul 23 13:30:25.823163 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.823126 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e"} err="failed to get container status \"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e\": rpc error: code = NotFound desc = could not find container \"c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e\": container with ID starting with c2d1ef64aeda38161118dcdfba42175d76f0364cd0f88609f14ce6e0e925b74e not found: ID does not exist" Jul 23 13:30:25.835313 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.835289 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:30:25.839335 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:25.839313 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fbff9785d-k895n"] Jul 23 13:30:26.154694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:26.154623 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" path="/var/lib/kubelet/pods/e3b52c88-2e50-4076-bc50-cce048ddfd8a/volumes" Jul 23 13:30:29.835671 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:29.835633 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" podUID="c1ce1128-6731-46b7-98bb-4cf71373dc62" containerName="registry" containerID="cri-o://ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf" gracePeriod=30 Jul 23 13:30:30.668548 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.668515 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:30:30.765844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765761 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.765844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765800 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.765844 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765836 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765867 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765908 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765951 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.765983 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cnd6\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.766023 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token\") pod \"c1ce1128-6731-46b7-98bb-4cf71373dc62\" (UID: \"c1ce1128-6731-46b7-98bb-4cf71373dc62\") " Jul 23 13:30:30.766630 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.766593 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:30:30.766846 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.766822 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:30:30.768945 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.768896 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:30:30.769040 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.768948 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:30:30.769040 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.769017 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:30:30.769133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.769052 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:30:30.769133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.769119 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6" (OuterVolumeSpecName: "kube-api-access-5cnd6") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "kube-api-access-5cnd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:30:30.774484 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.774461 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1ce1128-6731-46b7-98bb-4cf71373dc62" (UID: "c1ce1128-6731-46b7-98bb-4cf71373dc62"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:30:30.835417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.835385 2559 generic.go:356] "Generic (PLEG): container finished" podID="c1ce1128-6731-46b7-98bb-4cf71373dc62" containerID="ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf" exitCode=0 Jul 23 13:30:30.835581 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.835432 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" event={"ID":"c1ce1128-6731-46b7-98bb-4cf71373dc62","Type":"ContainerDied","Data":"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf"} Jul 23 13:30:30.835581 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.835434 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" Jul 23 13:30:30.835581 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.835512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cc5cf8577-t62qj" event={"ID":"c1ce1128-6731-46b7-98bb-4cf71373dc62","Type":"ContainerDied","Data":"5504142c1877d2e4af50dcd4876659c8e06e2aa5fe189a600e7daf5e65ea89b3"} Jul 23 13:30:30.835581 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.835527 2559 scope.go:117] "RemoveContainer" containerID="ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf" Jul 23 13:30:30.844820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.844800 2559 scope.go:117] "RemoveContainer" containerID="ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf" Jul 23 13:30:30.845131 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:30:30.845051 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf\": container with ID starting with ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf not found: ID does not exist" containerID="ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf" Jul 23 13:30:30.845131 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.845074 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf"} err="failed to get container status \"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf\": rpc error: code = NotFound desc = could not find container \"ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf\": container with ID starting with ef9fa2b22197c5f16b37c6ffae75e55cfe09397552ac89e760845b06d236d2bf not found: ID does not exist" Jul 23 13:30:30.858749 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.858725 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:30:30.864331 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.864308 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cc5cf8577-t62qj"] Jul 23 13:30:30.866890 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866862 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-image-registry-private-configuration\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.866890 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866885 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ce1128-6731-46b7-98bb-4cf71373dc62-ca-trust-extracted\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866896 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-certificates\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866906 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ce1128-6731-46b7-98bb-4cf71373dc62-trusted-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866915 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cnd6\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-kube-api-access-5cnd6\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866922 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-bound-sa-token\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866931 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ce1128-6731-46b7-98bb-4cf71373dc62-installation-pull-secrets\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:30.867014 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:30.866953 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ce1128-6731-46b7-98bb-4cf71373dc62-registry-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:30:32.153904 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:32.153828 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ce1128-6731-46b7-98bb-4cf71373dc62" path="/var/lib/kubelet/pods/c1ce1128-6731-46b7-98bb-4cf71373dc62/volumes" Jul 23 13:30:32.845692 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:32.845660 2559 generic.go:356] "Generic (PLEG): container finished" podID="3b3691aa-caa9-4972-9463-c8c5f97c6cb5" containerID="697b3709507f9a744464b14fa137f74781ab1e253c76fc82e37b29ae04a8785f" exitCode=0 Jul 23 13:30:32.845851 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:32.845731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" event={"ID":"3b3691aa-caa9-4972-9463-c8c5f97c6cb5","Type":"ContainerDied","Data":"697b3709507f9a744464b14fa137f74781ab1e253c76fc82e37b29ae04a8785f"} Jul 23 13:30:32.846067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:32.846054 2559 scope.go:117] "RemoveContainer" containerID="697b3709507f9a744464b14fa137f74781ab1e253c76fc82e37b29ae04a8785f" Jul 23 13:30:33.852268 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:33.852237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-njtbw" event={"ID":"3b3691aa-caa9-4972-9463-c8c5f97c6cb5","Type":"ContainerStarted","Data":"fdb34f4e94ace968e0ba6a6fb94df01b9fe9b889685e30441d062bfc95af51f6"} Jul 23 13:30:37.869117 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:37.869078 2559 generic.go:356] "Generic (PLEG): container finished" podID="f89006b5-00be-465c-af65-e92d0af22fbc" containerID="de40afa724e52a3ba1a98fef00045b24eb7206a5e1db106a33555ad224e94c43" exitCode=0 Jul 23 13:30:37.869117 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:37.869117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" event={"ID":"f89006b5-00be-465c-af65-e92d0af22fbc","Type":"ContainerDied","Data":"de40afa724e52a3ba1a98fef00045b24eb7206a5e1db106a33555ad224e94c43"} Jul 23 13:30:37.869535 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:37.869429 2559 scope.go:117] "RemoveContainer" containerID="de40afa724e52a3ba1a98fef00045b24eb7206a5e1db106a33555ad224e94c43" Jul 23 13:30:38.875336 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:38.875300 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qjmdh" event={"ID":"f89006b5-00be-465c-af65-e92d0af22fbc","Type":"ContainerStarted","Data":"4fc194095d1f15b719a7a35dcb7101c3a9a5d79ec19d9b73571f54a16f698496"} Jul 23 13:30:39.704069 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:39.704037 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:30:39.707837 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:30:39.707811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f56d5bc56-4h5fs" Jul 23 13:31:01.448053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:01.448015 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:01.463954 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:01.463928 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:01.990898 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:01.990871 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:15.336968 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.336936 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337313 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="alertmanager" containerID="cri-o://c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" gracePeriod=120 Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337338 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-metric" containerID="cri-o://801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" gracePeriod=120 Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337361 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="prom-label-proxy" containerID="cri-o://e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" gracePeriod=120 Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337392 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-web" containerID="cri-o://3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" gracePeriod=120 Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337407 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy" containerID="cri-o://9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" gracePeriod=120 Jul 23 13:31:15.337496 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:15.337431 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="config-reloader" containerID="cri-o://ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" gracePeriod=120 Jul 23 13:31:16.041363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041332 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" exitCode=0 Jul 23 13:31:16.041363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041356 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" exitCode=0 Jul 23 13:31:16.041363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041363 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" exitCode=0 Jul 23 13:31:16.041363 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041369 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" exitCode=0 Jul 23 13:31:16.041641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041393 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2"} Jul 23 13:31:16.041641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041444 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e"} Jul 23 13:31:16.041641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041469 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a"} Jul 23 13:31:16.041641 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.041493 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd"} Jul 23 13:31:16.592385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.592359 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:16.671468 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671397 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671468 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671431 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671468 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671456 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671486 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671548 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671573 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671608 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671630 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671654 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmm5t\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.671763 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671700 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.672113 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671770 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.672113 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671803 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.672113 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.671836 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy\") pod \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\" (UID: \"51e8fb95-f086-45f1-b086-a7f1e5cedbff\") " Jul 23 13:31:16.672269 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.672212 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:16.674269 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.674233 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:16.674396 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.674352 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:31:16.675070 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.674930 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.675070 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.674955 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:31:16.675070 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.675004 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.675070 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.675023 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.675070 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.675055 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.675458 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.675434 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out" (OuterVolumeSpecName: "config-out") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:31:16.676135 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.676108 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume" (OuterVolumeSpecName: "config-volume") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.676318 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.676297 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t" (OuterVolumeSpecName: "kube-api-access-fmm5t") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "kube-api-access-fmm5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:31:16.679967 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.679938 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.686209 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.686190 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config" (OuterVolumeSpecName: "web-config") pod "51e8fb95-f086-45f1-b086-a7f1e5cedbff" (UID: "51e8fb95-f086-45f1-b086-a7f1e5cedbff"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:16.773380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773344 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773374 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-tls-assets\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773380 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773385 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773395 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-main-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773406 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51e8fb95-f086-45f1-b086-a7f1e5cedbff-metrics-client-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773414 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmm5t\" (UniqueName: \"kubernetes.io/projected/51e8fb95-f086-45f1-b086-a7f1e5cedbff-kube-api-access-fmm5t\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773426 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-cluster-tls-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773434 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-alertmanager-main-db\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773442 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-volume\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773450 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773459 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51e8fb95-f086-45f1-b086-a7f1e5cedbff-config-out\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773468 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-web-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:16.773612 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:16.773476 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51e8fb95-f086-45f1-b086-a7f1e5cedbff-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:17.048879 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.048846 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" exitCode=0 Jul 23 13:31:17.048879 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.048873 2559 generic.go:356] "Generic (PLEG): container finished" podID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerID="3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" exitCode=0 Jul 23 13:31:17.049067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.048929 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.049067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.048929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9"} Jul 23 13:31:17.049133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.049070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781"} Jul 23 13:31:17.049133 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.049098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51e8fb95-f086-45f1-b086-a7f1e5cedbff","Type":"ContainerDied","Data":"912148af369f2ba455b08b99f7e2a3c956425e491d21e92b8f987d76aa773231"} Jul 23 13:31:17.049199 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.049136 2559 scope.go:117] "RemoveContainer" containerID="e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" Jul 23 13:31:17.057415 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.057397 2559 scope.go:117] "RemoveContainer" containerID="801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" Jul 23 13:31:17.064945 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.064925 2559 scope.go:117] "RemoveContainer" containerID="9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" Jul 23 13:31:17.071649 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.071632 2559 scope.go:117] "RemoveContainer" containerID="3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" Jul 23 13:31:17.078619 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.078584 2559 scope.go:117] "RemoveContainer" containerID="ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" Jul 23 13:31:17.082904 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.082884 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:17.085771 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.085753 2559 scope.go:117] "RemoveContainer" containerID="c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" Jul 23 13:31:17.093700 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.093675 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:17.094480 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.094464 2559 scope.go:117] "RemoveContainer" containerID="27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250" Jul 23 13:31:17.101603 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.101583 2559 scope.go:117] "RemoveContainer" containerID="e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" Jul 23 13:31:17.101897 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.101871 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2\": container with ID starting with e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2 not found: ID does not exist" containerID="e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" Jul 23 13:31:17.101981 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.101909 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2"} err="failed to get container status \"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2\": rpc error: code = NotFound desc = could not find container \"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2\": container with ID starting with e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2 not found: ID does not exist" Jul 23 13:31:17.101981 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.101935 2559 scope.go:117] "RemoveContainer" containerID="801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" Jul 23 13:31:17.102191 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.102172 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9\": container with ID starting with 801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9 not found: ID does not exist" containerID="801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" Jul 23 13:31:17.102236 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102196 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9"} err="failed to get container status \"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9\": rpc error: code = NotFound desc = could not find container \"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9\": container with ID starting with 801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9 not found: ID does not exist" Jul 23 13:31:17.102236 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102208 2559 scope.go:117] "RemoveContainer" containerID="9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" Jul 23 13:31:17.102475 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.102455 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e\": container with ID starting with 9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e not found: ID does not exist" containerID="9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" Jul 23 13:31:17.102568 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102479 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e"} err="failed to get container status \"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e\": rpc error: code = NotFound desc = could not find container \"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e\": container with ID starting with 9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e not found: ID does not exist" Jul 23 13:31:17.102568 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102495 2559 scope.go:117] "RemoveContainer" containerID="3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" Jul 23 13:31:17.102775 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.102758 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781\": container with ID starting with 3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781 not found: ID does not exist" containerID="3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" Jul 23 13:31:17.102824 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102777 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781"} err="failed to get container status \"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781\": rpc error: code = NotFound desc = could not find container \"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781\": container with ID starting with 3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781 not found: ID does not exist" Jul 23 13:31:17.102824 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.102789 2559 scope.go:117] "RemoveContainer" containerID="ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" Jul 23 13:31:17.103012 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.102993 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a\": container with ID starting with ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a not found: ID does not exist" containerID="ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" Jul 23 13:31:17.103060 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103018 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a"} err="failed to get container status \"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a\": rpc error: code = NotFound desc = could not find container \"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a\": container with ID starting with ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a not found: ID does not exist" Jul 23 13:31:17.103060 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103033 2559 scope.go:117] "RemoveContainer" containerID="c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" Jul 23 13:31:17.103272 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.103256 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd\": container with ID starting with c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd not found: ID does not exist" containerID="c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" Jul 23 13:31:17.103309 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103276 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd"} err="failed to get container status \"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd\": rpc error: code = NotFound desc = could not find container \"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd\": container with ID starting with c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd not found: ID does not exist" Jul 23 13:31:17.103309 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103289 2559 scope.go:117] "RemoveContainer" containerID="27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250" Jul 23 13:31:17.103516 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:17.103486 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250\": container with ID starting with 27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250 not found: ID does not exist" containerID="27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250" Jul 23 13:31:17.103559 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103518 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250"} err="failed to get container status \"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250\": rpc error: code = NotFound desc = could not find container \"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250\": container with ID starting with 27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250 not found: ID does not exist" Jul 23 13:31:17.103559 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103529 2559 scope.go:117] "RemoveContainer" containerID="e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2" Jul 23 13:31:17.103718 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103698 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2"} err="failed to get container status \"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2\": rpc error: code = NotFound desc = could not find container \"e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2\": container with ID starting with e2bb2d3cf1d02023ba00fd5398bd2b11eacc4b36af7079ec223d0fb245509ed2 not found: ID does not exist" Jul 23 13:31:17.103775 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103719 2559 scope.go:117] "RemoveContainer" containerID="801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9" Jul 23 13:31:17.103938 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103921 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9"} err="failed to get container status \"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9\": rpc error: code = NotFound desc = could not find container \"801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9\": container with ID starting with 801cd6a475b5189a078bcfbfba3c0583c6bf756f61b11bd09b34727dc7238cf9 not found: ID does not exist" Jul 23 13:31:17.103938 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.103936 2559 scope.go:117] "RemoveContainer" containerID="9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e" Jul 23 13:31:17.104169 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104150 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e"} err="failed to get container status \"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e\": rpc error: code = NotFound desc = could not find container \"9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e\": container with ID starting with 9c71b1bfb819fe7fd3e2a3e658e1fc064728aa0c91cb4a859b766baded94147e not found: ID does not exist" Jul 23 13:31:17.104239 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104171 2559 scope.go:117] "RemoveContainer" containerID="3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781" Jul 23 13:31:17.104401 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104384 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781"} err="failed to get container status \"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781\": rpc error: code = NotFound desc = could not find container \"3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781\": container with ID starting with 3f18a74f72641c85f5f9a7bee16939574fb9eca794e4abaefa497c8666c08781 not found: ID does not exist" Jul 23 13:31:17.104446 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104403 2559 scope.go:117] "RemoveContainer" containerID="ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a" Jul 23 13:31:17.104623 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104605 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a"} err="failed to get container status \"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a\": rpc error: code = NotFound desc = could not find container \"ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a\": container with ID starting with ee1dbf9c4e7117f7ed5e74800a96edde2932fc582fdc198e678a7e0aa09fee9a not found: ID does not exist" Jul 23 13:31:17.104688 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104626 2559 scope.go:117] "RemoveContainer" containerID="c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd" Jul 23 13:31:17.104851 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104836 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd"} err="failed to get container status \"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd\": rpc error: code = NotFound desc = could not find container \"c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd\": container with ID starting with c30ecb142b74cddfb7913186075f39ba973b50f02152ceac77e3f64216083acd not found: ID does not exist" Jul 23 13:31:17.104895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.104851 2559 scope.go:117] "RemoveContainer" containerID="27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250" Jul 23 13:31:17.105048 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.105031 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250"} err="failed to get container status \"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250\": rpc error: code = NotFound desc = could not find container \"27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250\": container with ID starting with 27a9c773ab58fb3b97b166696727cbd3da62184a110d785f88da557ada78f250 not found: ID does not exist" Jul 23 13:31:17.143680 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.143654 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:17.144033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144016 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="prom-label-proxy" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144035 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="prom-label-proxy" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144053 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="alertmanager" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144062 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="alertmanager" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144077 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-metric" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144087 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-metric" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144100 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="init-config-reloader" Jul 23 13:31:17.144110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144108 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="init-config-reloader" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144123 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ce1128-6731-46b7-98bb-4cf71373dc62" containerName="registry" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144132 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ce1128-6731-46b7-98bb-4cf71373dc62" containerName="registry" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144145 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" containerName="console" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144153 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" containerName="console" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144165 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="config-reloader" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144173 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="config-reloader" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144182 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-web" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144190 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-web" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144202 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144210 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144301 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b52c88-2e50-4076-bc50-cce048ddfd8a" containerName="console" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144315 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="alertmanager" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144327 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ce1128-6731-46b7-98bb-4cf71373dc62" containerName="registry" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144335 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144346 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="config-reloader" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144354 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-metric" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144363 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="prom-label-proxy" Jul 23 13:31:17.144439 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.144372 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" containerName="kube-rbac-proxy-web" Jul 23 13:31:17.150053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.150033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.153862 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.153841 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 13:31:17.153980 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.153922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 13:31:17.154058 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.153986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 13:31:17.154121 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.154071 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kvcrg\"" Jul 23 13:31:17.155782 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.155761 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 13:31:17.155877 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.155762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 13:31:17.155877 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.155762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 13:31:17.156982 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.156965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 13:31:17.161277 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.161261 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 13:31:17.162896 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.162855 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 13:31:17.176091 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-out\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176278 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176278 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqcjb\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-kube-api-access-sqcjb\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176278 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176365 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176365 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176328 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-web-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176365 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.176455 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.176427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.190613 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.190590 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:17.277860 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-web-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277911 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277964 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.277991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278398 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-out\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278398 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278398 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqcjb\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-kube-api-access-sqcjb\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278398 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.278398 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.278267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.279485 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.279456 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281317 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281334 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281942 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-config-out\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.281998 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.281923 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.282258 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.282235 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-web-config\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.283047 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.283026 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.283126 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.283101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.288694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.288673 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqcjb\" (UniqueName: \"kubernetes.io/projected/5ba955d5-4abd-42d5-bfdb-fd821ae1e98a-kube-api-access-sqcjb\") pod \"alertmanager-main-0\" (UID: \"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.459882 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.459850 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 13:31:17.628029 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:17.627993 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 13:31:18.055539 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:18.055490 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ba955d5-4abd-42d5-bfdb-fd821ae1e98a" containerID="d2f7b552cb563b4abe4b495877cad61b202e1a908228725c1d52de43caec4b71" exitCode=0 Jul 23 13:31:18.055689 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:18.055574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerDied","Data":"d2f7b552cb563b4abe4b495877cad61b202e1a908228725c1d52de43caec4b71"} Jul 23 13:31:18.055689 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:18.055640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"b21ecd5fc6a38b0a1c6474982fcf8457286669e960be3b44f5e49a36ec259457"} Jul 23 13:31:18.155421 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:18.155389 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e8fb95-f086-45f1-b086-a7f1e5cedbff" path="/var/lib/kubelet/pods/51e8fb95-f086-45f1-b086-a7f1e5cedbff/volumes" Jul 23 13:31:19.062815 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"5f3356f6c40a6fa64685d5093f3220136eab8ae0bba2e3c4721b55f00a8d6562"} Jul 23 13:31:19.063175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062850 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"a38a54dcd5ced0ba3a7d6d20952f29e6514bc79feb1c1f0078e51971efe9e87c"} Jul 23 13:31:19.063175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"29e2bc7b2c3f85176b341d12052f02e0eddd8160c0196ee5ef351bdebc70d8d1"} Jul 23 13:31:19.063175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"eed414627acf21b74802f43eca45c449278c5b749feb737752f3769590713742"} Jul 23 13:31:19.063175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"36a1ed5a34d30d1373aec5ca519be4cd545d4462d139e490204ef14011796dad"} Jul 23 13:31:19.063175 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.062948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ba955d5-4abd-42d5-bfdb-fd821ae1e98a","Type":"ContainerStarted","Data":"f70550fbd438c4a0540dabca8601c5061734489d1624b34ab5d4907cf7a1b7b8"} Jul 23 13:31:19.090895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.090804 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.079909943 podStartE2EDuration="2.090785087s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.875144ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:31:19.08947991 +0000 UTC m=+173.396857775" watchObservedRunningTime="2026-07-23 13:31:19.090785087 +0000 UTC m=+173.398162952" Jul 23 13:31:19.616974 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.616934 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:19.617307 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617263 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="prometheus" containerID="cri-o://f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" gracePeriod=600 Jul 23 13:31:19.617440 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617328 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-web" containerID="cri-o://558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" gracePeriod=600 Jul 23 13:31:19.617440 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617350 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="config-reloader" containerID="cri-o://132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" gracePeriod=600 Jul 23 13:31:19.617440 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617315 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-thanos" containerID="cri-o://901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" gracePeriod=600 Jul 23 13:31:19.617643 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617332 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="thanos-sidecar" containerID="cri-o://1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" gracePeriod=600 Jul 23 13:31:19.617643 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.617302 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy" containerID="cri-o://3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" gracePeriod=600 Jul 23 13:31:19.857246 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.857221 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:19.902279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902095 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902163 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902196 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902221 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902279 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902262 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902301 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902328 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902360 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902390 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902420 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ht6\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902448 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902489 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902561 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902546 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902581 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902617 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902638 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902681 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902706 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902765 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.902892 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.902791 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out\") pod \"f16769f4-ceb3-47ac-b238-7ef847647d25\" (UID: \"f16769f4-ceb3-47ac-b238-7ef847647d25\") " Jul 23 13:31:19.903908 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.903523 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.903908 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.903789 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.903908 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.903823 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.905607 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.905437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.905607 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.905591 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.905893 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.905657 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config" (OuterVolumeSpecName: "config") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.905952 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.905903 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.906632 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.906596 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 13:31:19.907120 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.907093 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:31:19.907955 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.907914 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.908053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.907994 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out" (OuterVolumeSpecName: "config-out") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:31:19.908053 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908004 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:31:19.908323 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908285 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.908323 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908307 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6" (OuterVolumeSpecName: "kube-api-access-q6ht6") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "kube-api-access-q6ht6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:31:19.908541 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908473 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.908541 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908496 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.908664 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.908647 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.909027 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.909006 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.909171 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.909153 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:19.923178 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:19.923155 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config" (OuterVolumeSpecName: "web-config") pod "f16769f4-ceb3-47ac-b238-7ef847647d25" (UID: "f16769f4-ceb3-47ac-b238-7ef847647d25"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 13:31:20.003463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003428 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003458 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-config-out\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003468 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003477 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-metrics-client-ca\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003487 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003496 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003529 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003540 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003548 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-kube-rbac-proxy\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003556 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-grpc-tls\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003566 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-web-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003574 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6ht6\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-kube-api-access-q6ht6\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003581 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-k8s-db\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003591 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003599 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f16769f4-ceb3-47ac-b238-7ef847647d25-tls-assets\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003607 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f16769f4-ceb3-47ac-b238-7ef847647d25-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003615 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-config\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003625 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003634 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-metrics-client-certs\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.003709 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.003642 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f16769f4-ceb3-47ac-b238-7ef847647d25-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:31:20.075931 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075893 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" exitCode=0 Jul 23 13:31:20.075931 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075928 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" exitCode=0 Jul 23 13:31:20.075931 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075937 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" exitCode=0 Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075946 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" exitCode=0 Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075958 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" exitCode=0 Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075967 2559 generic.go:356] "Generic (PLEG): container finished" podID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" exitCode=0 Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.075993 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076085 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076271 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} Jul 23 13:31:20.076384 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.076344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f16769f4-ceb3-47ac-b238-7ef847647d25","Type":"ContainerDied","Data":"44570bf540ef2461f87bfeeba61ac6203c79d3f7e5210724033c0f408adf881c"} Jul 23 13:31:20.085278 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.085245 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.092318 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.092298 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.099138 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.099119 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.102346 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.102324 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:20.106945 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.106925 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:20.106996 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.106946 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.113981 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.113965 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.120921 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.120904 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.127794 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.127779 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.128043 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.128022 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.128087 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128051 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.128087 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128067 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.128310 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.128291 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.128352 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128316 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.128352 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128332 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.128575 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.128558 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.128610 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128580 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.128610 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128593 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.128817 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.128799 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.128859 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128822 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.128859 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.128836 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.129051 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.129038 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.129091 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129054 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.129091 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129066 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.129266 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.129252 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.129305 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129268 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.129305 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129285 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.129537 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:31:20.129488 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.129537 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129519 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.129537 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129531 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.129770 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129749 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.129834 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129772 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.129996 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129978 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.130073 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.129998 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.130247 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130229 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.130298 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130248 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.130461 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130444 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.130523 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130463 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.130692 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130666 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.130762 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130693 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.130939 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130920 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.130993 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.130940 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.131161 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131143 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.131200 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131162 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.131385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131368 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.131446 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131387 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.131637 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131620 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.131684 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131638 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.131862 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131842 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.131924 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.131863 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.132047 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132031 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.132097 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132047 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.132258 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132242 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.132301 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132259 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.132477 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132459 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.132567 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132480 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.132723 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132708 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.132791 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132723 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.132956 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132930 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.132956 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.132947 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.133248 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133223 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.133248 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133246 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.133540 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133518 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.133660 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133547 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.133866 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133819 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.133959 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.133868 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.134310 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134282 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.134381 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134311 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.134611 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134585 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.134611 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134610 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.134820 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134798 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.134899 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.134821 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.135061 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135043 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.135113 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135062 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.135289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135268 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.135289 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135288 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.135532 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135491 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:20.135532 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135525 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.135630 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135541 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.135791 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135770 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.135846 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135793 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.135895 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135878 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="init-config-reloader" Jul 23 13:31:20.135936 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135899 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="init-config-reloader" Jul 23 13:31:20.135936 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135922 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-web" Jul 23 13:31:20.135936 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135929 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-web" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135942 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135951 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135962 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="config-reloader" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135970 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="config-reloader" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135979 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="thanos-sidecar" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135984 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="thanos-sidecar" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135990 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-thanos" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.135995 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-thanos" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136007 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="prometheus" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136013 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="prometheus" Jul 23 13:31:20.136033 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136021 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136037 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136074 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="thanos-sidecar" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136084 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="config-reloader" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136090 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-web" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136097 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="prometheus" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136108 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy-thanos" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136114 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" containerName="kube-rbac-proxy" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136259 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.136375 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136272 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.136717 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136496 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.136717 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136528 2559 scope.go:117] "RemoveContainer" containerID="901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622" Jul 23 13:31:20.136794 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136757 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622"} err="failed to get container status \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": rpc error: code = NotFound desc = could not find container \"901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622\": container with ID starting with 901a7e07e085ded16c054c1dc47a034d75d1017c016f13f2833d47dcfbacc622 not found: ID does not exist" Jul 23 13:31:20.136794 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136772 2559 scope.go:117] "RemoveContainer" containerID="3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927" Jul 23 13:31:20.136978 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136961 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927"} err="failed to get container status \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": rpc error: code = NotFound desc = could not find container \"3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927\": container with ID starting with 3eae947b6f1be9ad9d741086587fee7c521749ecdb8a1a6d7ae1a614f6e28927 not found: ID does not exist" Jul 23 13:31:20.137032 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.136980 2559 scope.go:117] "RemoveContainer" containerID="558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb" Jul 23 13:31:20.137231 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137216 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb"} err="failed to get container status \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": rpc error: code = NotFound desc = could not find container \"558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb\": container with ID starting with 558ce58eaeea9fb568e46008bbbdb155ebdae2a62909ba20e8bf8a812798cdfb not found: ID does not exist" Jul 23 13:31:20.137268 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137230 2559 scope.go:117] "RemoveContainer" containerID="1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b" Jul 23 13:31:20.137423 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137408 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b"} err="failed to get container status \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": rpc error: code = NotFound desc = could not find container \"1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b\": container with ID starting with 1a10366f28798d3b58c7af2f19b91fe259cfec85bd33c27e280c8e3ea052525b not found: ID does not exist" Jul 23 13:31:20.137423 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137421 2559 scope.go:117] "RemoveContainer" containerID="132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050" Jul 23 13:31:20.137674 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137654 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050"} err="failed to get container status \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": rpc error: code = NotFound desc = could not find container \"132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050\": container with ID starting with 132e02b796f2bf0b7b6b841de97bc2286a3ea54554fe35c501bdea5d4c9e6050 not found: ID does not exist" Jul 23 13:31:20.137724 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137679 2559 scope.go:117] "RemoveContainer" containerID="f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f" Jul 23 13:31:20.137911 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137892 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f"} err="failed to get container status \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": rpc error: code = NotFound desc = could not find container \"f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f\": container with ID starting with f0249951332c4c1c700df3e246d98626bdd790f3afb282948fe912545922343f not found: ID does not exist" Jul 23 13:31:20.137969 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.137914 2559 scope.go:117] "RemoveContainer" containerID="40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb" Jul 23 13:31:20.138122 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.138106 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb"} err="failed to get container status \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": rpc error: code = NotFound desc = could not find container \"40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb\": container with ID starting with 40262e1a6e7945bebb72446a5d8704350bcdcb377c0d22195e90f3e591304beb not found: ID does not exist" Jul 23 13:31:20.141691 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.141677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.144001 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.143984 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 13:31:20.144368 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144346 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 13:31:20.144495 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144476 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 13:31:20.144604 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144590 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 13:31:20.144680 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144599 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 13:31:20.144680 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144630 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 13:31:20.145000 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.144983 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 13:31:20.145516 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 13:31:20.145586 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145523 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 13:31:20.145586 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145539 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 13:31:20.145681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145526 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 13:31:20.145681 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9col1fqhj0umv\"" Jul 23 13:31:20.145787 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.145704 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lqzmz\"" Jul 23 13:31:20.146059 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.146044 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 13:31:20.148584 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.148568 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 13:31:20.151894 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.151874 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 13:31:20.154150 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.154103 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f16769f4-ceb3-47ac-b238-7ef847647d25" path="/var/lib/kubelet/pods/f16769f4-ceb3-47ac-b238-7ef847647d25/volumes" Jul 23 13:31:20.159228 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.159211 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:20.205804 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.205901 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhplj\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-kube-api-access-bhplj\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.205901 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.205901 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205976 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.205993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206129 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206215 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206261 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206419 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.206419 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.206303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307582 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307582 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307755 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307755 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307836 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307774 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhplj\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-kube-api-access-bhplj\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307836 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307836 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.307979 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.307974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.308207 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.308165 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.308438 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.308411 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.308702 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.308678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.308881 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.308856 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309034 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309295 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309426 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309411 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309547 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309532 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309677 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309805 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.309912 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.309897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.310765 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.310735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.310858 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.310835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311030 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311109 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311317 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311293 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-web-config\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311317 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311307 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311449 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311664 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.311919 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311897 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.312009 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.311989 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.312946 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.312925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.313385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.313367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.313452 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.313431 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e290b31-b86d-45c3-951e-9a1d2f87ad99-config-out\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.313596 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.313578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4e290b31-b86d-45c3-951e-9a1d2f87ad99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.313889 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.313873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4e290b31-b86d-45c3-951e-9a1d2f87ad99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.318224 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.318203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhplj\" (UniqueName: \"kubernetes.io/projected/4e290b31-b86d-45c3-951e-9a1d2f87ad99-kube-api-access-bhplj\") pod \"prometheus-k8s-0\" (UID: \"4e290b31-b86d-45c3-951e-9a1d2f87ad99\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.453030 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.452996 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:31:20.604235 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:20.604198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 13:31:20.607277 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:31:20.607249 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e290b31_b86d_45c3_951e_9a1d2f87ad99.slice/crio-a8e1695cf0f9d2c571fadbb36eac64204e2183678c4533c5ddfba205f9ad6946 WatchSource:0}: Error finding container a8e1695cf0f9d2c571fadbb36eac64204e2183678c4533c5ddfba205f9ad6946: Status 404 returned error can't find the container with id a8e1695cf0f9d2c571fadbb36eac64204e2183678c4533c5ddfba205f9ad6946 Jul 23 13:31:21.082738 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:21.082641 2559 generic.go:356] "Generic (PLEG): container finished" podID="4e290b31-b86d-45c3-951e-9a1d2f87ad99" containerID="cde379ee44f8d2b35902f30b7e1e947be017bfee9a6d9c918fcd42dcc7b838ce" exitCode=0 Jul 23 13:31:21.083122 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:21.082732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerDied","Data":"cde379ee44f8d2b35902f30b7e1e947be017bfee9a6d9c918fcd42dcc7b838ce"} Jul 23 13:31:21.083122 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:21.082801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"a8e1695cf0f9d2c571fadbb36eac64204e2183678c4533c5ddfba205f9ad6946"} Jul 23 13:31:22.091071 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"b3010360198c4835562b6db6ebdd616172791711e311404921224c40bf695c0f"} Jul 23 13:31:22.091472 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"5012ee0bd6fcb3d4eac983b45da3cbc8612015c2159f8225afb316ca6bfc3e26"} Jul 23 13:31:22.091472 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091156 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"ec9538b9065a0e631275a2ed01b4d1efc00bf2adb94a794a3b57d257bccdf305"} Jul 23 13:31:22.091472 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"36074481bcfae59ac03119a608bb4ba8e14fe510006ca1153a04bae9340d57bf"} Jul 23 13:31:22.091472 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"b8f2c0d6f74f56415d4672657d5f70de22f916963c7307ae77618fcb717b2b82"} Jul 23 13:31:22.091472 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.091227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4e290b31-b86d-45c3-951e-9a1d2f87ad99","Type":"ContainerStarted","Data":"ce8efc908d464062db198f4b705e400382203a831ca4a47f524a405af3a6cc19"} Jul 23 13:31:22.121694 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:22.121622 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.10296132 podStartE2EDuration="2.12159187s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.63055ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:31:22.11961534 +0000 UTC m=+176.426993229" watchObservedRunningTime="2026-07-23 13:31:22.12159187 +0000 UTC m=+176.428969736" Jul 23 13:31:25.453388 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:31:25.453351 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:32:20.454183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:32:20.454145 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:32:20.470367 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:32:20.470341 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:32:21.352815 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:32:21.352785 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 13:33:26.041137 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:26.041099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:33:26.047635 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:26.047604 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:33:26.053686 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:26.053668 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 13:33:37.517171 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.517136 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-6rczt"] Jul 23 13:33:37.520590 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.520574 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.522827 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.522800 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 23 13:33:37.523385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.523366 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-bwdf2\"" Jul 23 13:33:37.523526 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.523392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 23 13:33:37.531114 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.531091 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-6rczt"] Jul 23 13:33:37.612055 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.612011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lbd\" (UniqueName: \"kubernetes.io/projected/210d8b49-8b15-496c-8a41-4eb8beff9c70-kube-api-access-82lbd\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.612230 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.612073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/210d8b49-8b15-496c-8a41-4eb8beff9c70-tmp\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.713185 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.713153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lbd\" (UniqueName: \"kubernetes.io/projected/210d8b49-8b15-496c-8a41-4eb8beff9c70-kube-api-access-82lbd\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.713370 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.713214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/210d8b49-8b15-496c-8a41-4eb8beff9c70-tmp\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.713654 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.713632 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/210d8b49-8b15-496c-8a41-4eb8beff9c70-tmp\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.721693 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.721670 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lbd\" (UniqueName: \"kubernetes.io/projected/210d8b49-8b15-496c-8a41-4eb8beff9c70-kube-api-access-82lbd\") pod \"jobset-operator-5bc45f897-6rczt\" (UID: \"210d8b49-8b15-496c-8a41-4eb8beff9c70\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.840174 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.840089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" Jul 23 13:33:37.970991 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.970958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-6rczt"] Jul 23 13:33:37.973565 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:33:37.973540 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod210d8b49_8b15_496c_8a41_4eb8beff9c70.slice/crio-f765be300a41ab65d9e30f0a853dfb37b8e8dfd51823b0843dbde2059c343733 WatchSource:0}: Error finding container f765be300a41ab65d9e30f0a853dfb37b8e8dfd51823b0843dbde2059c343733: Status 404 returned error can't find the container with id f765be300a41ab65d9e30f0a853dfb37b8e8dfd51823b0843dbde2059c343733 Jul 23 13:33:37.975260 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:37.975237 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 13:33:38.661538 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:38.661480 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" event={"ID":"210d8b49-8b15-496c-8a41-4eb8beff9c70","Type":"ContainerStarted","Data":"f765be300a41ab65d9e30f0a853dfb37b8e8dfd51823b0843dbde2059c343733"} Jul 23 13:33:41.677366 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:41.677331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" event={"ID":"210d8b49-8b15-496c-8a41-4eb8beff9c70","Type":"ContainerStarted","Data":"37331a41a62d37523aee2ba8c7e8e09bd2f022cad05f027ab4c8703b2452e361"} Jul 23 13:33:41.694040 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:33:41.693991 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-6rczt" podStartSLOduration=1.786252621 podStartE2EDuration="4.69397452s" totalImagesPullingTime="2.907721899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:33:41.692973822 +0000 UTC m=+316.000351701" watchObservedRunningTime="2026-07-23 13:33:41.69397452 +0000 UTC m=+316.001352383" Jul 23 13:37:26.932184 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.932141 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-72k58/must-gather-j4t4j"] Jul 23 13:37:26.935964 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.935947 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:26.939169 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.939147 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-72k58\"/\"default-dockercfg-lhv2m\"" Jul 23 13:37:26.939803 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.939781 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72k58\"/\"kube-root-ca.crt\"" Jul 23 13:37:26.939927 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.939884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-72k58\"/\"openshift-service-ca.crt\"" Jul 23 13:37:26.948408 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:26.948382 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72k58/must-gather-j4t4j"] Jul 23 13:37:27.020827 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.020793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7pw4\" (UniqueName: \"kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.021007 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.020864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.122106 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.122060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.122286 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.122144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7pw4\" (UniqueName: \"kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.122425 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.122406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.131123 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.131101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7pw4\" (UniqueName: \"kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4\") pod \"must-gather-j4t4j\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.244670 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.244631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:37:27.375934 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.375911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-72k58/must-gather-j4t4j"] Jul 23 13:37:27.378214 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:37:27.378186 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f9d14fb_1abc_4eee_8464_808a98fe5049.slice/crio-257c63a1d77886ad208c33288620e2d800fa2fefe9eadaf1f1da855245a93b97 WatchSource:0}: Error finding container 257c63a1d77886ad208c33288620e2d800fa2fefe9eadaf1f1da855245a93b97: Status 404 returned error can't find the container with id 257c63a1d77886ad208c33288620e2d800fa2fefe9eadaf1f1da855245a93b97 Jul 23 13:37:27.635086 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:27.635006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72k58/must-gather-j4t4j" event={"ID":"1f9d14fb-1abc-4eee-8464-808a98fe5049","Type":"ContainerStarted","Data":"257c63a1d77886ad208c33288620e2d800fa2fefe9eadaf1f1da855245a93b97"} Jul 23 13:37:34.675891 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:34.675853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72k58/must-gather-j4t4j" event={"ID":"1f9d14fb-1abc-4eee-8464-808a98fe5049","Type":"ContainerStarted","Data":"7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad"} Jul 23 13:37:34.676273 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:34.675905 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72k58/must-gather-j4t4j" event={"ID":"1f9d14fb-1abc-4eee-8464-808a98fe5049","Type":"ContainerStarted","Data":"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934"} Jul 23 13:37:34.692873 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:37:34.692804 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-72k58/must-gather-j4t4j" podStartSLOduration=2.509015737 podStartE2EDuration="8.692784636s" totalImagesPullingTime="6.183768899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:37:34.692535547 +0000 UTC m=+548.999913427" watchObservedRunningTime="2026-07-23 13:37:34.692784636 +0000 UTC m=+549.000162500" Jul 23 13:38:22.933192 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:22.933156 2559 generic.go:356] "Generic (PLEG): container finished" podID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerID="bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934" exitCode=0 Jul 23 13:38:22.933647 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:22.933229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-72k58/must-gather-j4t4j" event={"ID":"1f9d14fb-1abc-4eee-8464-808a98fe5049","Type":"ContainerDied","Data":"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934"} Jul 23 13:38:22.933647 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:22.933588 2559 scope.go:117] "RemoveContainer" containerID="bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934" Jul 23 13:38:23.055274 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:23.055241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-72k58_must-gather-j4t4j_1f9d14fb-1abc-4eee-8464-808a98fe5049/gather/0.log" Jul 23 13:38:26.073879 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:26.073855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:38:26.076637 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:26.076605 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:38:26.412596 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:26.412524 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xl7cf_b5f1cee3-3d69-411b-b9a2-d68ceb2f0dc1/global-pull-secret-syncer/0.log" Jul 23 13:38:26.498566 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:26.498534 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fbxln_ef724c99-74b1-42d1-b1f5-8b0d7617218b/konnectivity-agent/0.log" Jul 23 13:38:26.588599 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:26.588574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-209.ec2.internal_bb35003e3a2089e3489c75f90e5d25fe/haproxy/0.log" Jul 23 13:38:28.423183 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.423148 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-72k58/must-gather-j4t4j"] Jul 23 13:38:28.423663 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.423329 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-72k58/must-gather-j4t4j" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="copy" containerID="cri-o://7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad" gracePeriod=2 Jul 23 13:38:28.427662 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.427237 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-72k58/must-gather-j4t4j"] Jul 23 13:38:28.660402 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.660379 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-72k58_must-gather-j4t4j_1f9d14fb-1abc-4eee-8464-808a98fe5049/copy/0.log" Jul 23 13:38:28.662958 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.662942 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:38:28.664659 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:38:28.664637 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j4t4j\" is forbidden: User \"system:node:ip-10-0-135-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-72k58\": no relationship found between node 'ip-10-0-135-209.ec2.internal' and this object" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:38:28.690714 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.690643 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output\") pod \"1f9d14fb-1abc-4eee-8464-808a98fe5049\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " Jul 23 13:38:28.690714 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.690680 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7pw4\" (UniqueName: \"kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4\") pod \"1f9d14fb-1abc-4eee-8464-808a98fe5049\" (UID: \"1f9d14fb-1abc-4eee-8464-808a98fe5049\") " Jul 23 13:38:28.692858 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.692831 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "1f9d14fb-1abc-4eee-8464-808a98fe5049" (UID: "1f9d14fb-1abc-4eee-8464-808a98fe5049"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 13:38:28.692973 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.692950 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4" (OuterVolumeSpecName: "kube-api-access-d7pw4") pod "1f9d14fb-1abc-4eee-8464-808a98fe5049" (UID: "1f9d14fb-1abc-4eee-8464-808a98fe5049"). InnerVolumeSpecName "kube-api-access-d7pw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 13:38:28.792119 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.792084 2559 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1f9d14fb-1abc-4eee-8464-808a98fe5049-must-gather-output\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:38:28.792119 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.792112 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7pw4\" (UniqueName: \"kubernetes.io/projected/1f9d14fb-1abc-4eee-8464-808a98fe5049-kube-api-access-d7pw4\") on node \"ip-10-0-135-209.ec2.internal\" DevicePath \"\"" Jul 23 13:38:28.962931 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.962901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-72k58_must-gather-j4t4j_1f9d14fb-1abc-4eee-8464-808a98fe5049/copy/0.log" Jul 23 13:38:28.963269 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.963247 2559 generic.go:356] "Generic (PLEG): container finished" podID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerID="7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad" exitCode=143 Jul 23 13:38:28.963317 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.963291 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:38:28.963367 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.963350 2559 scope.go:117] "RemoveContainer" containerID="7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad" Jul 23 13:38:28.965140 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:38:28.965110 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j4t4j\" is forbidden: User \"system:node:ip-10-0-135-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-72k58\": no relationship found between node 'ip-10-0-135-209.ec2.internal' and this object" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:38:28.976376 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:38:28.976350 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-j4t4j\" is forbidden: User \"system:node:ip-10-0-135-209.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-72k58\": no relationship found between node 'ip-10-0-135-209.ec2.internal' and this object" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" pod="openshift-must-gather-72k58/must-gather-j4t4j" Jul 23 13:38:28.977725 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.977704 2559 scope.go:117] "RemoveContainer" containerID="bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934" Jul 23 13:38:28.989067 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.989043 2559 scope.go:117] "RemoveContainer" containerID="7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad" Jul 23 13:38:28.989346 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:38:28.989325 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad\": container with ID starting with 7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad not found: ID does not exist" containerID="7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad" Jul 23 13:38:28.989433 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.989352 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad"} err="failed to get container status \"7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad\": rpc error: code = NotFound desc = could not find container \"7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad\": container with ID starting with 7be327ed876e38e1d2138c85551c72b577ac6d1d249660e13e33815715fa0dad not found: ID does not exist" Jul 23 13:38:28.989433 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.989371 2559 scope.go:117] "RemoveContainer" containerID="bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934" Jul 23 13:38:28.989631 ip-10-0-135-209 kubenswrapper[2559]: E0723 13:38:28.989612 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934\": container with ID starting with bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934 not found: ID does not exist" containerID="bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934" Jul 23 13:38:28.989673 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:28.989637 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934"} err="failed to get container status \"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934\": rpc error: code = NotFound desc = could not find container \"bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934\": container with ID starting with bf94da9f877c1d4f79d756eb60e57ad51c9ca297f6e4dc8633b2373d4f597934 not found: ID does not exist" Jul 23 13:38:30.118317 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.118288 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/alertmanager/0.log" Jul 23 13:38:30.149911 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.149879 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/config-reloader/0.log" Jul 23 13:38:30.154199 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.154171 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" path="/var/lib/kubelet/pods/1f9d14fb-1abc-4eee-8464-808a98fe5049/volumes" Jul 23 13:38:30.183879 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.183846 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/kube-rbac-proxy-web/0.log" Jul 23 13:38:30.209226 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.209203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/kube-rbac-proxy/0.log" Jul 23 13:38:30.240224 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.240195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/kube-rbac-proxy-metric/0.log" Jul 23 13:38:30.321330 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.321302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/prom-label-proxy/0.log" Jul 23 13:38:30.353968 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.353944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5ba955d5-4abd-42d5-bfdb-fd821ae1e98a/init-config-reloader/0.log" Jul 23 13:38:30.398590 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.398561 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-qq9s9_4e8f0efd-de87-401e-a102-02814b8e3f8a/cluster-monitoring-operator/0.log" Jul 23 13:38:30.511621 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.511540 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f56d5bc56-4h5fs_82af9775-e95d-413d-8284-889cd2b1e3ca/metrics-server/0.log" Jul 23 13:38:30.545087 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.545059 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-8rcqd_c485192c-da5d-468f-bf51-2f0d9cfd2da0/monitoring-plugin/0.log" Jul 23 13:38:30.693970 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.693943 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqjv5_c555759b-51f5-4ab8-a1c3-7b1382632a64/node-exporter/0.log" Jul 23 13:38:30.720271 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.720241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqjv5_c555759b-51f5-4ab8-a1c3-7b1382632a64/kube-rbac-proxy/0.log" Jul 23 13:38:30.747982 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.747956 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sqjv5_c555759b-51f5-4ab8-a1c3-7b1382632a64/init-textfile/0.log" Jul 23 13:38:30.957301 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.957274 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/prometheus/0.log" Jul 23 13:38:30.985264 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:30.985238 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/config-reloader/0.log" Jul 23 13:38:31.009495 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.009469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/thanos-sidecar/0.log" Jul 23 13:38:31.036962 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.036938 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/kube-rbac-proxy-web/0.log" Jul 23 13:38:31.068657 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.068633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/kube-rbac-proxy/0.log" Jul 23 13:38:31.095565 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.095520 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/kube-rbac-proxy-thanos/0.log" Jul 23 13:38:31.122790 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.122766 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4e290b31-b86d-45c3-951e-9a1d2f87ad99/init-config-reloader/0.log" Jul 23 13:38:31.243041 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.242949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-596ddf88-t6jbr_8b31e47d-0308-4d4e-af60-c99130070775/telemeter-client/0.log" Jul 23 13:38:31.270463 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.270435 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-596ddf88-t6jbr_8b31e47d-0308-4d4e-af60-c99130070775/reload/0.log" Jul 23 13:38:31.295107 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.295081 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-596ddf88-t6jbr_8b31e47d-0308-4d4e-af60-c99130070775/kube-rbac-proxy/0.log" Jul 23 13:38:31.332249 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.332221 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/thanos-query/0.log" Jul 23 13:38:31.369911 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.369885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/kube-rbac-proxy-web/0.log" Jul 23 13:38:31.406720 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.406690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/kube-rbac-proxy/0.log" Jul 23 13:38:31.434703 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.434682 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/prom-label-proxy/0.log" Jul 23 13:38:31.477189 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.477166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/kube-rbac-proxy-rules/0.log" Jul 23 13:38:31.519387 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:31.519313 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85b8d55584-c54gv_fa49ab5f-4a8c-4e1a-8779-69f26073ecca/kube-rbac-proxy-metrics/0.log" Jul 23 13:38:32.705471 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:32.705444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-6gv7d_723df8ae-c3df-49cd-8544-4028f78dfa1a/networking-console-plugin/0.log" Jul 23 13:38:33.157899 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.157826 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/1.log" Jul 23 13:38:33.162110 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.162090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-nn5fz_55515c93-3a88-45fb-8024-7e0222aedba4/console-operator/2.log" Jul 23 13:38:33.578056 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578020 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc"] Jul 23 13:38:33.578422 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578409 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="copy" Jul 23 13:38:33.578467 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578424 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="copy" Jul 23 13:38:33.578467 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578441 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="gather" Jul 23 13:38:33.578467 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578446 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="gather" Jul 23 13:38:33.578596 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578526 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="gather" Jul 23 13:38:33.578596 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.578538 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9d14fb-1abc-4eee-8464-808a98fe5049" containerName="copy" Jul 23 13:38:33.583688 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.583662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.586417 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.586388 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f9hnr\"/\"openshift-service-ca.crt\"" Jul 23 13:38:33.586933 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.586915 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f9hnr\"/\"default-dockercfg-wcjhw\"" Jul 23 13:38:33.587046 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.586916 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f9hnr\"/\"kube-root-ca.crt\"" Jul 23 13:38:33.593610 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.593581 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc"] Jul 23 13:38:33.632708 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.632665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-sys\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.632915 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.632713 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xn2k\" (UniqueName: \"kubernetes.io/projected/b539fbb9-4d32-4508-ad26-8038fb1f58a3-kube-api-access-6xn2k\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.632915 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.632770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-proc\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.632915 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.632858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-podres\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.632915 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.632882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-lib-modules\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734045 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-sys\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xn2k\" (UniqueName: \"kubernetes.io/projected/b539fbb9-4d32-4508-ad26-8038fb1f58a3-kube-api-access-6xn2k\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-proc\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-sys\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-podres\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-proc\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-lib-modules\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-lib-modules\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.734492 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.734316 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b539fbb9-4d32-4508-ad26-8038fb1f58a3-podres\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.743259 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.743236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xn2k\" (UniqueName: \"kubernetes.io/projected/b539fbb9-4d32-4508-ad26-8038fb1f58a3-kube-api-access-6xn2k\") pod \"perf-node-gather-daemonset-dbzsc\" (UID: \"b539fbb9-4d32-4508-ad26-8038fb1f58a3\") " pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:33.895047 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:33.894949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:34.030270 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:34.030244 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc"] Jul 23 13:38:34.033030 ip-10-0-135-209 kubenswrapper[2559]: W0723 13:38:34.033002 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb539fbb9_4d32_4508_ad26_8038fb1f58a3.slice/crio-6baa4df4981d09e62e79eab6b6fb11ba24eb174869af14ab97642f96b6657f73 WatchSource:0}: Error finding container 6baa4df4981d09e62e79eab6b6fb11ba24eb174869af14ab97642f96b6657f73: Status 404 returned error can't find the container with id 6baa4df4981d09e62e79eab6b6fb11ba24eb174869af14ab97642f96b6657f73 Jul 23 13:38:34.194062 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:34.194035 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-d7ktx_7076b2b8-7139-439e-83f9-8091f0ff61f5/volume-data-source-validator/0.log" Jul 23 13:38:34.995831 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:34.995793 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" event={"ID":"b539fbb9-4d32-4508-ad26-8038fb1f58a3","Type":"ContainerStarted","Data":"4747dca7da6b151caa577931281ca3eb0c447076b7c3161cf73b3a30a38ff3b2"} Jul 23 13:38:34.996225 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:34.995858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" event={"ID":"b539fbb9-4d32-4508-ad26-8038fb1f58a3","Type":"ContainerStarted","Data":"6baa4df4981d09e62e79eab6b6fb11ba24eb174869af14ab97642f96b6657f73"} Jul 23 13:38:34.996225 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:34.995891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:35.015154 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:35.015104 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" podStartSLOduration=2.015090402 podStartE2EDuration="2.015090402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:38:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:38:35.013159707 +0000 UTC m=+609.320537570" watchObservedRunningTime="2026-07-23 13:38:35.015090402 +0000 UTC m=+609.322468311" Jul 23 13:38:35.129154 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:35.129123 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w22w6_32ac3642-3f9f-49c6-bc0f-94ff4596f96d/dns/0.log" Jul 23 13:38:35.154808 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:35.154775 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w22w6_32ac3642-3f9f-49c6-bc0f-94ff4596f96d/kube-rbac-proxy/0.log" Jul 23 13:38:35.232985 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:35.232944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xbzw_a52c75d5-60a4-4087-8906-b9fc00c78c70/dns-node-resolver/0.log" Jul 23 13:38:35.777757 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:35.777724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2v75_199b62d0-5ee5-4dbf-90c8-6aa843c3cce1/node-ca/0.log" Jul 23 13:38:36.554491 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:36.554456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-667b94bf6b-psv2s_ea3e357d-6967-4084-938a-5e8ded4a2766/router/0.log" Jul 23 13:38:36.911397 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:36.911323 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9cd67_a60472c7-2c27-49bf-a8b6-a405f81ec481/serve-healthcheck-canary/0.log" Jul 23 13:38:37.364117 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:37.364090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-4zksx_96ef5d24-3666-4d91-a28d-7b3d94c524ad/insights-operator/1.log" Jul 23 13:38:37.369262 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:37.369240 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-4zksx_96ef5d24-3666-4d91-a28d-7b3d94c524ad/insights-operator/0.log" Jul 23 13:38:37.488617 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:37.488589 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c258_158c4331-933f-4f86-8e37-155888ca4228/kube-rbac-proxy/0.log" Jul 23 13:38:37.513182 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:37.513155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c258_158c4331-933f-4f86-8e37-155888ca4228/exporter/0.log" Jul 23 13:38:37.536990 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:37.536896 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6c258_158c4331-933f-4f86-8e37-155888ca4228/extractor/0.log" Jul 23 13:38:39.342034 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:39.342002 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-6rczt_210d8b49-8b15-496c-8a41-4eb8beff9c70/jobset-operator/0.log" Jul 23 13:38:41.011837 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:41.011805 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f9hnr/perf-node-gather-daemonset-dbzsc" Jul 23 13:38:43.152900 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:43.152869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-njtbw_3b3691aa-caa9-4972-9463-c8c5f97c6cb5/kube-storage-version-migrator-operator/0.log" Jul 23 13:38:43.154913 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:43.154892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-njtbw_3b3691aa-caa9-4972-9463-c8c5f97c6cb5/kube-storage-version-migrator-operator/1.log" Jul 23 13:38:44.102822 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.102788 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/kube-multus-additional-cni-plugins/0.log" Jul 23 13:38:44.131002 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.130970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/egress-router-binary-copy/0.log" Jul 23 13:38:44.153733 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.153702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/cni-plugins/0.log" Jul 23 13:38:44.179261 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.179233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/bond-cni-plugin/0.log" Jul 23 13:38:44.206748 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.206725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/routeoverride-cni/0.log" Jul 23 13:38:44.231541 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.231520 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/whereabouts-cni-bincopy/0.log" Jul 23 13:38:44.258800 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.258774 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8lxf_ee4c17db-1d7b-4409-a34b-e575cbdc4ea6/whereabouts-cni/0.log" Jul 23 13:38:44.713690 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.713654 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jlxx2_1cbccaf9-6015-41b0-a84f-d9cb1ba8897d/kube-multus/0.log" Jul 23 13:38:44.923644 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.923619 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zsddw_ca30a538-b7c1-4e4c-940e-7e8e16758427/network-metrics-daemon/0.log" Jul 23 13:38:44.949233 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:44.949200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zsddw_ca30a538-b7c1-4e4c-940e-7e8e16758427/kube-rbac-proxy/0.log" Jul 23 13:38:46.204194 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.204159 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/ovn-controller/0.log" Jul 23 13:38:46.227006 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.226978 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/ovn-acl-logging/0.log" Jul 23 13:38:46.254230 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.254193 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/kube-rbac-proxy-node/0.log" Jul 23 13:38:46.279587 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.279562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 13:38:46.300552 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.300525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/northd/0.log" Jul 23 13:38:46.324385 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.324355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/nbdb/0.log" Jul 23 13:38:46.346894 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.346861 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/sbdb/0.log" Jul 23 13:38:46.391324 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:46.391286 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wc7f2_6e493d4b-f257-49b4-9e95-7a84bf95928a/ovnkube-controller/0.log" Jul 23 13:38:47.393263 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:47.393222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-h5tv8_32e611b2-b360-43d2-a042-9bdda881631c/check-endpoints/0.log" Jul 23 13:38:47.418724 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:47.418696 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-74tzz_de58fa93-e762-42f4-9d7d-637324a85981/network-check-target-container/0.log" Jul 23 13:38:48.492364 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:48.492285 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vd7jb_55d26310-2da8-44da-a416-abd9a03bec08/iptables-alerter/0.log" Jul 23 13:38:49.211849 ip-10-0-135-209 kubenswrapper[2559]: I0723 13:38:49.211821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-nh9mx_1f52cde9-c7ee-4002-98dc-adab6c16ff42/tuned/0.log"