Jul 08 16:32:01.818737 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 16:32:01.818746 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 16:32:01.818753 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 16:32:01.818966 ip-10-0-134-45 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 16:32:11.975196 ip-10-0-134-45 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 16:32:11.975214 ip-10-0-134-45 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dd7a4a48a1dd48c398c936eb4ec69cdb -- Jul 08 16:34:16.599998 ip-10-0-134-45 systemd[1]: Starting Kubernetes Kubelet... Jul 08 16:34:17.012881 ip-10-0-134-45 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:17.012881 ip-10-0-134-45 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 16:34:17.012881 ip-10-0-134-45 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:17.012881 ip-10-0-134-45 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 16:34:17.012881 ip-10-0-134-45 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 16:34:17.013555 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.012943 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 16:34:17.017894 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017878 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.017894 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017895 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017899 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017902 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017906 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017909 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017912 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017916 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017919 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017922 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017925 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017928 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017932 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017936 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017940 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017943 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017946 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017955 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017958 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017961 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.017963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017964 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017967 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017970 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017973 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017976 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017979 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017983 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017985 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017988 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017991 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017995 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.017999 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018003 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018006 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018008 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018011 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018013 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018016 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018019 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018022 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.018443 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018024 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018027 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018030 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018032 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018035 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018037 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018040 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018043 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018045 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018049 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018051 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018054 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018057 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018060 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018064 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018067 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018070 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018072 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018075 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018078 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.018985 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018080 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018083 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018085 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018088 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018091 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018093 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018096 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018098 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018101 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018104 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018106 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018109 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018112 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018114 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018117 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018121 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018123 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018126 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018129 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018131 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.019495 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018134 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018137 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018140 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018144 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018147 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018151 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018154 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018158 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018161 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018164 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018167 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018171 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018174 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018176 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018182 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018184 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018187 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018190 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.020021 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018927 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018934 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018938 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018941 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018944 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018948 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018950 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018953 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018956 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018959 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018962 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018965 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018968 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018970 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018973 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018976 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018979 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018982 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018987 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018992 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.020511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018995 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.018998 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019001 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019004 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019006 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019009 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019012 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019015 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019019 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019023 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019026 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019028 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019032 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019034 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019037 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019040 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019044 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019046 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019049 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.021044 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019052 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019054 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019057 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019060 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019063 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019065 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019068 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019071 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019073 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019078 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019083 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019087 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019090 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019093 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019096 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019098 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019101 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019104 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019106 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.021537 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019109 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019112 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019114 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019117 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019120 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019123 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019126 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019128 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019131 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019136 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019139 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019141 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019144 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019147 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019149 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019152 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019155 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019158 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019161 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019164 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.022062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019166 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019169 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019172 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019174 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019178 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019180 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019183 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019186 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019189 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019192 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019195 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019197 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019200 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019203 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019205 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019208 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019211 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019214 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019216 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019219 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.022578 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019222 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019591 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019596 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019600 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019602 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019605 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019608 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019612 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019616 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019619 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019622 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019625 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019628 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019630 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019633 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019636 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019640 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019642 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019645 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019648 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.023126 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019651 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019654 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019656 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019660 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019662 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019665 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019668 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019670 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019673 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019676 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019678 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019681 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019684 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019688 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019691 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019693 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019696 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019699 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019702 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019705 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.023644 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019708 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019710 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019713 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019715 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019718 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019721 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019724 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019727 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019730 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019733 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019736 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019739 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019742 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019744 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019747 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019750 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019752 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019755 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019757 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.024165 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019760 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019763 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019765 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019768 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019770 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019773 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019795 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019801 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019804 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019807 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019810 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019813 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019816 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019819 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019821 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019824 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019827 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019830 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019833 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.024701 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019835 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019839 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019841 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019845 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019848 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019850 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019853 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019855 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019858 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019861 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019864 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019866 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019869 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019873 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019876 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019880 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019882 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019885 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019888 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019892 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.025215 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019895 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.019897 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.019971 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.019982 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.019989 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.019993 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.019998 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020001 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020006 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020010 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020013 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020018 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020022 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020026 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020030 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020033 2577 flags.go:64] FLAG: --cgroup-root="" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020037 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020040 2577 flags.go:64] FLAG: --client-ca-file="" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020044 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020047 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020051 2577 flags.go:64] FLAG: --cluster-domain="" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020054 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020057 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020060 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 16:34:17.025740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020064 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020068 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020071 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020074 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020078 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020081 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020084 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020089 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020092 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020095 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020100 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020103 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020106 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020109 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020112 2577 flags.go:64] FLAG: --enable-server="true" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020115 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020120 2577 flags.go:64] FLAG: --event-burst="100" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020123 2577 flags.go:64] FLAG: --event-qps="50" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020126 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020131 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020134 2577 flags.go:64] FLAG: --eviction-hard="" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020138 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020142 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020145 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020148 2577 flags.go:64] FLAG: --eviction-soft="" Jul 08 16:34:17.026413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020151 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020155 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020158 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020161 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020165 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020168 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020170 2577 flags.go:64] FLAG: --feature-gates="" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020175 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020178 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020181 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020185 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020188 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020191 2577 flags.go:64] FLAG: --help="false" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020194 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020199 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020202 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020205 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020209 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020212 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020215 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020218 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020221 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020224 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 16:34:17.027084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020227 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020231 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020234 2577 flags.go:64] FLAG: --kube-reserved="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020238 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020241 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020244 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020247 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020258 2577 flags.go:64] FLAG: --lock-file="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020262 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020266 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020269 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020275 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020278 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020281 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020284 2577 flags.go:64] FLAG: --logging-format="text" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020287 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020291 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020294 2577 flags.go:64] FLAG: --manifest-url="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020297 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020302 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020305 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020309 2577 flags.go:64] FLAG: --max-pods="110" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020312 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020317 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020320 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 16:34:17.027773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020323 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020326 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020329 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020332 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020340 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020343 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020346 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020349 2577 flags.go:64] FLAG: --pod-cidr="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020352 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020358 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020364 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020368 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020371 2577 flags.go:64] FLAG: --port="10250" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020374 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020377 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f63f369498c6017d" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020381 2577 flags.go:64] FLAG: --qos-reserved="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020384 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020387 2577 flags.go:64] FLAG: --register-node="true" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020390 2577 flags.go:64] FLAG: --register-with-taints="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020394 2577 flags.go:64] FLAG: --registry-burst="10" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020398 2577 flags.go:64] FLAG: --registry-qps="5" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020401 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020404 2577 flags.go:64] FLAG: --reserved-memory="" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020407 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020411 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 16:34:17.028453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020414 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020417 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020420 2577 flags.go:64] FLAG: --runonce="false" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020423 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020426 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020429 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020433 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020437 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020440 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020443 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020446 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020450 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020453 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020456 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020459 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020462 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020465 2577 flags.go:64] FLAG: --system-cgroups="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020469 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020474 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020477 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020480 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020485 2577 flags.go:64] FLAG: --tls-min-version="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020489 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020492 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020495 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 16:34:17.029312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020497 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020501 2577 flags.go:64] FLAG: --v="2" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020508 2577 flags.go:64] FLAG: --version="false" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020512 2577 flags.go:64] FLAG: --vmodule="" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020516 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.020520 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020641 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020645 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020648 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020652 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020654 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020657 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020660 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020664 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020667 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020670 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020672 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020675 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020678 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020680 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020683 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.030270 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020686 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020689 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020692 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020695 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020698 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020701 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020703 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020706 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020709 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020712 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020714 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020717 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020719 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020722 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020725 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020728 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020731 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020733 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020736 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020739 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.030848 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020741 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020744 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020746 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020749 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020753 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020755 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020758 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020761 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020764 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020766 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020769 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020772 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020775 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020793 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020797 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020801 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020804 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020806 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020809 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020812 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.031374 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020815 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020817 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020820 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020823 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020826 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020829 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020832 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020835 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020839 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020843 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020847 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020850 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020853 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020856 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020859 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020862 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020866 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020869 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020872 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020874 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.031932 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020877 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020880 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020883 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020886 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020889 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020892 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020894 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020897 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020900 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020903 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020906 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020909 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020912 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020914 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020917 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020920 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020923 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020929 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020931 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.032458 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020934 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020937 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020940 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020944 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.020947 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.021711 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.030649 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.030664 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.031421 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.031430 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031493 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031498 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031502 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031505 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.033111 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031508 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031511 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031513 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031516 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031519 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031522 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031525 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031528 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031530 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031533 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031536 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031539 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031543 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031546 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031548 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031551 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031554 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031557 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031559 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.033516 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031562 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031565 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031568 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031572 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031576 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031579 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031582 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031585 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031588 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031591 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031595 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031598 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031601 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031605 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031608 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031611 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031613 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031617 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031620 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.034022 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031623 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031626 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031630 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031634 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031638 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031642 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031645 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031648 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031651 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031654 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031657 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031660 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031663 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031665 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031668 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031671 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031674 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031677 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031680 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031683 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.034511 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031685 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031688 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031692 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031695 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031698 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031701 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031704 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031706 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031709 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031712 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031715 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031717 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031720 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031723 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031725 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031728 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031731 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031734 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031737 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031740 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.035042 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031743 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031745 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031748 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031751 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031754 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031756 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031759 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031762 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031766 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031770 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031773 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031775 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031792 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031794 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031798 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031801 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.035557 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031804 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.031809 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031925 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031931 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031934 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031937 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031940 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031943 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031946 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031949 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031953 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031955 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031958 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031961 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031965 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 16:34:17.036098 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031968 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031971 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031974 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031977 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031980 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031983 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031985 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031988 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031991 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031993 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031996 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.031999 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032002 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032004 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032008 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032011 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032014 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032017 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032020 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 16:34:17.036518 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032023 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032025 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032029 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032031 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032034 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032037 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032039 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032042 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032045 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032047 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032050 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032053 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032055 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032058 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032061 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032063 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032066 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032070 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032073 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032075 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 16:34:17.037062 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032078 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032081 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032084 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032087 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032090 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032092 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032095 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032098 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032101 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032104 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032107 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032110 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032112 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032115 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032118 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032120 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032123 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032126 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032129 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032133 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 16:34:17.037593 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032136 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032139 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032142 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032144 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032147 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032150 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032155 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032159 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032162 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032165 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032169 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032172 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032175 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032178 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032180 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032183 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032186 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032189 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032191 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 16:34:17.038201 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032194 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032197 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032200 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032202 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032205 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032208 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032211 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:17.032213 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.032218 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.032323 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.036354 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.037959 2577 server.go:1019] "Starting client certificate rotation" Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.038087 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:17.038749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.038134 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 16:34:17.040284 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.040265 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:17.043354 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.043336 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 16:34:17.055196 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.055178 2577 log.go:25] "Validated CRI v1 runtime API" Jul 08 16:34:17.057656 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.057640 2577 log.go:25] "Validated CRI v1 image API" Jul 08 16:34:17.058561 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.058544 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 16:34:17.063613 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.063592 2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b84d7151-d7e7-47d8-be16-ae0c5a8bf0d3:/dev/nvme0n1p4 c1c06206-43cc-44e6-9478-081251c68227:/dev/nvme0n1p3] Jul 08 16:34:17.063693 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.063611 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 16:34:17.070208 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.070093 2577 manager.go:216] Machine: {Timestamp:2026-07-08 16:34:17.068664104 +0000 UTC m=+0.350374168 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099119 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a39aa9bb958c0929e495541c9dafe SystemUUID:ec2a39aa-9bb9-58c0-929e-495541c9dafe BootID:dd7a4a48-a1dd-48c3-98c9-36eb4ec69cdb Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dc:d8:0a:6c:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dc:d8:0a:6c:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:41:c1:5b:44:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 16:34:17.070208 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.070205 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 16:34:17.070338 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.070323 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 16:34:17.073593 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.073565 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 16:34:17.073813 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.073595 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-45.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 16:34:17.074998 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.074985 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 16:34:17.075037 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.075002 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 16:34:17.075037 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.075010 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:17.075986 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.075974 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 16:34:17.076361 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.076344 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:17.077789 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.077766 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 16:34:17.081793 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.081770 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:17.081928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.081917 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 16:34:17.081967 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.081949 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 08 16:34:17.081967 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.081963 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 16:34:17.082024 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.081979 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 16:34:17.082053 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.082028 2577 kubelet.go:398] "Adding apiserver pod source" Jul 08 16:34:17.082053 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.082038 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 16:34:17.082600 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.082581 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:17.082653 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.082619 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 16:34:17.086587 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.086560 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 16:34:17.088954 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.088938 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 16:34:17.089035 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.088971 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 16:34:17.090507 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090496 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090513 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090519 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090525 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090534 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090539 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090547 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090553 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090560 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090566 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090575 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 16:34:17.090596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.090582 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 16:34:17.091444 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.091433 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 16:34:17.091444 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.091443 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 16:34:17.095009 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.094985 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-45.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 16:34:17.095099 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.095013 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 16:34:17.095099 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.095021 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 16:34:17.095179 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.095165 2577 server.go:1268] "Started kubelet" Jul 08 16:34:17.095225 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.095206 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 16:34:17.095336 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.095294 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 16:34:17.095386 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.095355 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 16:34:17.096757 ip-10-0-134-45 systemd[1]: Started Kubernetes Kubelet. Jul 08 16:34:17.098396 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.098381 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 08 16:34:17.100137 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.100116 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 16:34:17.100392 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.100370 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 16:34:17.103450 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.102477 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-45.ec2.internal.18c05daea3f49abe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-45.ec2.internal,UID:ip-10-0-134-45.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-45.ec2.internal,},FirstTimestamp:2026-07-08 16:34:17.095125694 +0000 UTC m=+0.376835759,LastTimestamp:2026-07-08 16:34:17.095125694 +0000 UTC m=+0.376835759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-45.ec2.internal,}" Jul 08 16:34:17.109264 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.109241 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 16:34:17.109264 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.109250 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:17.109879 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.109504 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.110180 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.110124 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 16:34:17.110180 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.110141 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 16:34:17.110180 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.110124 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 16:34:17.110374 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.110230 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 08 16:34:17.110374 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.110240 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 08 16:34:17.110850 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.110823 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-45.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 16:34:17.111101 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.111083 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 16:34:17.111930 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.111912 2577 factory.go:55] Registering systemd factory Jul 08 16:34:17.111930 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.111928 2577 factory.go:223] Registration of the systemd container factory successfully Jul 08 16:34:17.112190 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112176 2577 factory.go:153] Registering CRI-O factory Jul 08 16:34:17.112190 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112188 2577 factory.go:223] Registration of the crio container factory successfully Jul 08 16:34:17.112299 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112236 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 16:34:17.112299 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112262 2577 factory.go:103] Registering Raw factory Jul 08 16:34:17.112299 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112279 2577 manager.go:1196] Started watching for new ooms in manager Jul 08 16:34:17.112756 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.112739 2577 manager.go:349] Starting recovery of all containers Jul 08 16:34:17.116011 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.115985 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2kncb" Jul 08 16:34:17.125137 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.125117 2577 manager.go:354] Recovery completed Jul 08 16:34:17.127546 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.127527 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2kncb" Jul 08 16:34:17.129357 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.129343 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.131123 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131109 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.131191 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131139 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.131191 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131149 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.131804 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131766 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 16:34:17.131804 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131778 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 16:34:17.131804 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131794 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.131957 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.131796 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 08 16:34:17.132519 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.132506 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.132578 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.132542 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.132578 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.132554 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.133179 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.133165 2577 policy_none.go:49] "None policy: Start" Jul 08 16:34:17.133179 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.133182 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 16:34:17.133292 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.133193 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 16:34:17.134244 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.134227 2577 policy_none.go:47] "Start" Jul 08 16:34:17.177475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.177411 2577 manager.go:337] "Starting Device Plugin manager" Jul 08 16:34:17.177582 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.177518 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 16:34:17.177582 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.177533 2577 server.go:87] "Starting device plugin registration server" Jul 08 16:34:17.177829 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.177815 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 16:34:17.177902 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.177831 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 16:34:17.177956 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.177921 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 16:34:17.178034 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.178014 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 16:34:17.178034 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.178030 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 16:34:17.178594 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.178569 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 16:34:17.178669 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.178632 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.278716 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.278663 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.280497 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.279753 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.280497 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.279782 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.280497 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.279793 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.280497 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.279827 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.289993 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.289968 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.290113 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.289998 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-45.ec2.internal\": node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.306986 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.306959 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.332778 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.332751 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 16:34:17.334105 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.334080 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 16:34:17.334198 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.334120 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 16:34:17.334198 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.334144 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 16:34:17.334198 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.334178 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 16:34:17.336923 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.336906 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:17.409247 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.409188 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.435076 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.435019 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal"] Jul 08 16:34:17.435138 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.435092 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.437066 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.437048 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.437175 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.437086 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.437175 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.437101 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.438650 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.438630 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.438768 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.438747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.438843 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.438777 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.439494 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439478 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.439554 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439479 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.439554 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439537 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.439554 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439552 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.439648 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439510 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.439648 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.439593 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.441066 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.441049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.441116 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.441076 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 16:34:17.441827 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.441811 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientMemory" Jul 08 16:34:17.441876 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.441840 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 16:34:17.441876 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.441854 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeHasSufficientPID" Jul 08 16:34:17.462556 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.462534 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.ec2.internal\" not found" node="ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.467127 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.467110 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-45.ec2.internal\" not found" node="ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.510291 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.510249 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.511482 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.511463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.511562 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.511514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.511562 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.511546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2742cb3cdbcf3416c4ac6825708c8f-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"6f2742cb3cdbcf3416c4ac6825708c8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.610571 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.610537 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.611797 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.611853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.611853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611820 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2742cb3cdbcf3416c4ac6825708c8f-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"6f2742cb3cdbcf3416c4ac6825708c8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.611853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6f2742cb3cdbcf3416c4ac6825708c8f-config\") pod \"kube-apiserver-proxy-ip-10-0-134-45.ec2.internal\" (UID: \"6f2742cb3cdbcf3416c4ac6825708c8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.611951 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.611951 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.611878 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cf3b9a3cd42a58e6a7720c3110882b5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal\" (UID: \"2cf3b9a3cd42a58e6a7720c3110882b5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.714224 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.714129 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.770592 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.770563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.771779 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.771761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:17.814637 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.814605 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:17.911766 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:17.911718 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:17.915531 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:17.915512 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:18.015828 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:18.015755 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:18.037732 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.037695 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 16:34:18.037918 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.037874 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 16:34:18.037958 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.037907 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 16:34:18.116396 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:18.116364 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:18.130128 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.130093 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 16:29:17 +0000 UTC" deadline="2028-03-10 02:52:17.196906129 +0000 UTC" Jul 08 16:34:18.130128 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.130125 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14650h17m59.066783893s" Jul 08 16:34:18.217163 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:18.217136 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-45.ec2.internal\" not found" Jul 08 16:34:18.258069 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.258044 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:18.310011 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.309933 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" Jul 08 16:34:18.327263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.327236 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:18.328260 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.328246 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" Jul 08 16:34:18.336759 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.336679 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 16:34:18.448509 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:18.448476 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf3b9a3cd42a58e6a7720c3110882b5.slice/crio-7a8aed6c458edf91a2a3c2cf2e96fc64ba7ce75b56c47d56f21f512978dab0d8 WatchSource:0}: Error finding container 7a8aed6c458edf91a2a3c2cf2e96fc64ba7ce75b56c47d56f21f512978dab0d8: Status 404 returned error can't find the container with id 7a8aed6c458edf91a2a3c2cf2e96fc64ba7ce75b56c47d56f21f512978dab0d8 Jul 08 16:34:18.448852 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:18.448830 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2742cb3cdbcf3416c4ac6825708c8f.slice/crio-64abe6179e8af287292190da107c81832f8774b58ee98f73bf13bf353b819d94 WatchSource:0}: Error finding container 64abe6179e8af287292190da107c81832f8774b58ee98f73bf13bf353b819d94: Status 404 returned error can't find the container with id 64abe6179e8af287292190da107c81832f8774b58ee98f73bf13bf353b819d94 Jul 08 16:34:18.453781 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.453600 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:34:18.712616 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:18.712583 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:19.085613 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.085512 2577 apiserver.go:52] "Watching apiserver" Jul 08 16:34:19.095160 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.095130 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 16:34:19.096364 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.096340 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-n8gml","openshift-network-operator/iptables-alerter-826nj","openshift-ovn-kubernetes/ovnkube-node-lthzr","kube-system/global-pull-secret-syncer-d59t8","kube-system/konnectivity-agent-x4x5j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal","openshift-multus/multus-additional-cni-plugins-8jf8m","openshift-multus/multus-wnkqt","openshift-network-diagnostics/network-check-target-5c5x4","kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zqvsk","openshift-dns/node-resolver-j5562","openshift-image-registry/node-ca-rzsz5"] Jul 08 16:34:19.098038 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.098010 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:19.098142 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.098080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:19.099258 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.099240 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.100919 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.100903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.102193 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.102179 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.102270 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.102231 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:19.103544 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.103521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.104764 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.104744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.106258 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.106238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.107916 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.107896 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.108043 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108020 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.108152 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kzhr4\"" Jul 08 16:34:19.108223 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108204 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.108933 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108683 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5p56q\"" Jul 08 16:34:19.108933 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108718 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 16:34:19.108933 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 16:34:19.108933 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108809 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 16:34:19.109193 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.108999 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.109193 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109035 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 16:34:19.109296 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109206 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ldstl\"" Jul 08 16:34:19.109352 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109324 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.109408 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109348 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.109408 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 16:34:19.109408 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109386 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 16:34:19.109645 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109625 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.109718 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109650 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 16:34:19.109718 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109692 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.109853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.109631 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 16:34:19.110238 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.110215 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 16:34:19.110950 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.110906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 16:34:19.113046 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.111801 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.113046 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.112066 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.113361 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.113290 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.113615 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.113478 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:19.115154 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-htztx\"" Jul 08 16:34:19.115252 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115171 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2qgv7\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115309 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115422 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115677 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nq8p7\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115782 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115840 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.115924 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 16:34:19.116185 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.116113 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rml4q\"" Jul 08 16:34:19.116598 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.116228 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.116598 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.116396 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.117711 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.117688 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.118949 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.118927 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 16:34:19.119284 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.119232 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 16:34:19.119397 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.119239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w79xx\"" Jul 08 16:34:19.119671 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.119653 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 16:34:19.119921 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.119902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:34:19.120549 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.120533 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gpkml\"" Jul 08 16:34:19.123885 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.123983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/617927bf-79d1-4421-a466-f4174ba28b6a-host\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.123983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.123983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123929 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:19.123983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-netd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.123983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.123971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-config\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx5s7\" (UniqueName: \"kubernetes.io/projected/2418860c-84f5-443c-aac8-cee1470fe314-kube-api-access-nx5s7\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6kg\" (UniqueName: \"kubernetes.io/projected/ab19915c-b054-4a34-bfab-78a28e491357-kube-api-access-nx6kg\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.124188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-ovn\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.124188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-system-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-kubelet-config\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-conf-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-netns\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61818f9-d863-4b87-9a65-ed69ae954595-tmp-dir\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-socket-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124325 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cnibin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-kubelet\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124380 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-kubelet\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-bin\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.124406 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124410 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-env-overrides\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-sys-fs\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cni-binary-copy\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-multus-certs\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-etc-kubernetes\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgn9c\" (UniqueName: \"kubernetes.io/projected/617927bf-79d1-4421-a466-f4174ba28b6a-kube-api-access-bgn9c\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2418860c-84f5-443c-aac8-cee1470fe314-ovn-node-metrics-cert\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124544 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-script-lib\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-netns\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-hostroot\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-registration-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-device-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zz2d\" (UniqueName: \"kubernetes.io/projected/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kube-api-access-8zz2d\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-os-release\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-k8s-cni-cncf-io\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125006 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124764 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-node-log\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124799 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-multus\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab19915c-b054-4a34-bfab-78a28e491357-host-slash\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-systemd-units\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d61818f9-d863-4b87-9a65-ed69ae954595-hosts-file\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-daemon-config\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/617927bf-79d1-4421-a466-f4174ba28b6a-serviceca\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-dbus\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.124994 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghmcs\" (UniqueName: \"kubernetes.io/projected/d61818f9-d863-4b87-9a65-ed69ae954595-kube-api-access-ghmcs\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6p7\" (UniqueName: \"kubernetes.io/projected/a8bb9ce6-692c-4573-a534-0d17b0f87bea-kube-api-access-df6p7\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vc8\" (UniqueName: \"kubernetes.io/projected/b4bff7c4-503c-465b-a028-1f48a7318748-kube-api-access-b4vc8\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-var-lib-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-etc-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.125825 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-systemd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-log-socket\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/451d0f44-1597-47cf-bde4-ab0795a84742-konnectivity-ca\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-socket-dir-parent\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-slash\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/451d0f44-1597-47cf-bde4-ab0795a84742-agent-certs\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-bin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.126760 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.125313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab19915c-b054-4a34-bfab-78a28e491357-iptables-alerter-script\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.134315 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.134294 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 16:34:19.168152 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.168131 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t6svk" Jul 08 16:34:19.178649 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.178625 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t6svk" Jul 08 16:34:19.211427 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.211398 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 16:34:19.225696 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225663 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-conf-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225752 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-conf-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-kubernetes\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-netns\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225851 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-netns\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.225859 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61818f9-d863-4b87-9a65-ed69ae954595-tmp-dir\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-socket-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.225999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cnibin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-socket-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.226168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-modprobe-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cnibin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-var-lib-kubelet\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-tmp\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-kubelet\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-kubelet\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-kubelet\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsg8h\" (UniqueName: \"kubernetes.io/projected/a4c45543-0832-4a4c-b780-1d83bd716200-kube-api-access-wsg8h\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-bin\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d61818f9-d863-4b87-9a65-ed69ae954595-tmp-dir\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-kubelet\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226381 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-env-overrides\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.226410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-sys-fs\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-bin\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226470 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-sys-fs\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cni-binary-copy\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-multus-certs\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-etc-kubernetes\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgn9c\" (UniqueName: \"kubernetes.io/projected/617927bf-79d1-4421-a466-f4174ba28b6a-kube-api-access-bgn9c\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226689 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-multus-certs\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cnibin\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2418860c-84f5-443c-aac8-cee1470fe314-ovn-node-metrics-cert\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226789 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-etc-kubernetes\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-script-lib\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-netns\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysconfig\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-hostroot\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226961 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-env-overrides\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227007 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.226967 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-registration-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-device-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227087 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zz2d\" (UniqueName: \"kubernetes.io/projected/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kube-api-access-8zz2d\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-registration-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-os-release\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227203 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-netns\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-os-release\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-cni-binary-copy\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-device-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-k8s-cni-cncf-io\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-run-k8s-cni-cncf-io\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-node-log\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227017 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-hostroot\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227347 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227376 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-node-log\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.227824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227411 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-multus\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab19915c-b054-4a34-bfab-78a28e491357-host-slash\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-run-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-multus\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab19915c-b054-4a34-bfab-78a28e491357-host-slash\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-systemd\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-systemd-units\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227742 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d61818f9-d863-4b87-9a65-ed69ae954595-hosts-file\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-systemd-units\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-lib-modules\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-daemon-config\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d61818f9-d863-4b87-9a65-ed69ae954595-hosts-file\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227848 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/617927bf-79d1-4421-a466-f4174ba28b6a-serviceca\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-sys\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.228643 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-dbus\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghmcs\" (UniqueName: \"kubernetes.io/projected/d61818f9-d863-4b87-9a65-ed69ae954595-kube-api-access-ghmcs\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.227971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6p7\" (UniqueName: \"kubernetes.io/projected/a8bb9ce6-692c-4573-a534-0d17b0f87bea-kube-api-access-df6p7\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vc8\" (UniqueName: \"kubernetes.io/projected/b4bff7c4-503c-465b-a028-1f48a7318748-kube-api-access-b4vc8\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-run\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-var-lib-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-etc-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-dbus\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-systemd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228150 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-var-lib-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-script-lib\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-systemd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-etc-openvswitch\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-log-socket\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/451d0f44-1597-47cf-bde4-ab0795a84742-konnectivity-ca\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228668 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.229493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-socket-dir-parent\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-system-cni-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-os-release\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-slash\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/617927bf-79d1-4421-a466-f4174ba28b6a-serviceca\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228900 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/451d0f44-1597-47cf-bde4-ab0795a84742-agent-certs\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-bin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.228984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-daemon-config\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab19915c-b054-4a34-bfab-78a28e491357-iptables-alerter-script\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-conf\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229107 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-host\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/617927bf-79d1-4421-a466-f4174ba28b6a-host\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzvfm\" (UniqueName: \"kubernetes.io/projected/95facfe2-602f-4673-a321-e9cbe2b6ba6d-kube-api-access-jzvfm\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.230382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-netd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-config\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx5s7\" (UniqueName: \"kubernetes.io/projected/2418860c-84f5-443c-aac8-cee1470fe314-kube-api-access-nx5s7\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-multus-socket-dir-parent\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.229453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-host-var-lib-cni-bin\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230082 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab19915c-b054-4a34-bfab-78a28e491357-iptables-alerter-script\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230204 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/451d0f44-1597-47cf-bde4-ab0795a84742-konnectivity-ca\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230269 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/617927bf-79d1-4421-a466-f4174ba28b6a-host\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6kg\" (UniqueName: \"kubernetes.io/projected/ab19915c-b054-4a34-bfab-78a28e491357-kube-api-access-nx6kg\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230337 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-ovn\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-cni-netd\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.230424 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-run-ovn\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230845 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2418860c-84f5-443c-aac8-cee1470fe314-ovnkube-config\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.230853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-host-slash\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.231247 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.230936 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.230990 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:19.730937475 +0000 UTC m=+3.012647551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-system-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.231035 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:19.731007525 +0000 UTC m=+3.012717590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-etc-tuned\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8bb9ce6-692c-4573-a534-0d17b0f87bea-system-cni-dir\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-kubelet-config\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231187 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2418860c-84f5-443c-aac8-cee1470fe314-log-socket\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/096d2ce7-f666-481f-a7a7-03bbab8947f2-kubelet-config\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.232084 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.231461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2418860c-84f5-443c-aac8-cee1470fe314-ovn-node-metrics-cert\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.233231 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.233018 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/451d0f44-1597-47cf-bde4-ab0795a84742-agent-certs\") pod \"konnectivity-agent-x4x5j\" (UID: \"451d0f44-1597-47cf-bde4-ab0795a84742\") " pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.237594 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.237568 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgn9c\" (UniqueName: \"kubernetes.io/projected/617927bf-79d1-4421-a466-f4174ba28b6a-kube-api-access-bgn9c\") pod \"node-ca-rzsz5\" (UID: \"617927bf-79d1-4421-a466-f4174ba28b6a\") " pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.237836 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.237817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghmcs\" (UniqueName: \"kubernetes.io/projected/d61818f9-d863-4b87-9a65-ed69ae954595-kube-api-access-ghmcs\") pod \"node-resolver-j5562\" (UID: \"d61818f9-d863-4b87-9a65-ed69ae954595\") " pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.241221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.241198 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vc8\" (UniqueName: \"kubernetes.io/projected/b4bff7c4-503c-465b-a028-1f48a7318748-kube-api-access-b4vc8\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.242938 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.242914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zz2d\" (UniqueName: \"kubernetes.io/projected/52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc-kube-api-access-8zz2d\") pod \"aws-ebs-csi-driver-node-9xfz6\" (UID: \"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.243018 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.243008 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6p7\" (UniqueName: \"kubernetes.io/projected/a8bb9ce6-692c-4573-a534-0d17b0f87bea-kube-api-access-df6p7\") pod \"multus-wnkqt\" (UID: \"a8bb9ce6-692c-4573-a534-0d17b0f87bea\") " pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.246322 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.246291 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:19.246322 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.246312 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:19.246322 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.246327 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:19.246502 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.246394 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:19.746374307 +0000 UTC m=+3.028084373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:19.248478 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.248457 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6kg\" (UniqueName: \"kubernetes.io/projected/ab19915c-b054-4a34-bfab-78a28e491357-kube-api-access-nx6kg\") pod \"iptables-alerter-826nj\" (UID: \"ab19915c-b054-4a34-bfab-78a28e491357\") " pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.248959 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.248936 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx5s7\" (UniqueName: \"kubernetes.io/projected/2418860c-84f5-443c-aac8-cee1470fe314-kube-api-access-nx5s7\") pod \"ovnkube-node-lthzr\" (UID: \"2418860c-84f5-443c-aac8-cee1470fe314\") " pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.332031 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.331994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332232 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-conf\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332232 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-host\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332232 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzvfm\" (UniqueName: \"kubernetes.io/projected/95facfe2-602f-4673-a321-e9cbe2b6ba6d-kube-api-access-jzvfm\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332232 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-etc-tuned\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-kubernetes\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-modprobe-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-var-lib-kubelet\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-tmp\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsg8h\" (UniqueName: \"kubernetes.io/projected/a4c45543-0832-4a4c-b780-1d83bd716200-kube-api-access-wsg8h\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cnibin\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysconfig\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-host\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-systemd\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-systemd\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-var-lib-kubelet\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332686 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332708 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-modprobe-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.332837 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysconfig\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332638 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-d\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333134 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-sysctl-conf\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.332685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cnibin\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-lib-modules\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-sys\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-run\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-system-cni-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333329 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-os-release\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-os-release\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333428 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-lib-modules\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333316 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-run\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95facfe2-602f-4673-a321-e9cbe2b6ba6d-system-cni-dir\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-sys\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.333808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333557 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c45543-0832-4a4c-b780-1d83bd716200-etc-kubernetes\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.334159 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.333842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95facfe2-602f-4673-a321-e9cbe2b6ba6d-cni-binary-copy\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.335464 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.335426 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-etc-tuned\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.336773 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.336627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4c45543-0832-4a4c-b780-1d83bd716200-tmp\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.341556 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.341497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" event={"ID":"6f2742cb3cdbcf3416c4ac6825708c8f","Type":"ContainerStarted","Data":"64abe6179e8af287292190da107c81832f8774b58ee98f73bf13bf353b819d94"} Jul 08 16:34:19.343115 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.343088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzvfm\" (UniqueName: \"kubernetes.io/projected/95facfe2-602f-4673-a321-e9cbe2b6ba6d-kube-api-access-jzvfm\") pod \"multus-additional-cni-plugins-8jf8m\" (UID: \"95facfe2-602f-4673-a321-e9cbe2b6ba6d\") " pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.343539 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.343514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsg8h\" (UniqueName: \"kubernetes.io/projected/a4c45543-0832-4a4c-b780-1d83bd716200-kube-api-access-wsg8h\") pod \"tuned-zqvsk\" (UID: \"a4c45543-0832-4a4c-b780-1d83bd716200\") " pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.344126 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.344089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"2cf3b9a3cd42a58e6a7720c3110882b5","Type":"ContainerStarted","Data":"7a8aed6c458edf91a2a3c2cf2e96fc64ba7ce75b56c47d56f21f512978dab0d8"} Jul 08 16:34:19.412039 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.411998 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j5562" Jul 08 16:34:19.422322 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.422246 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:19.422672 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.422632 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61818f9_d863_4b87_9a65_ed69ae954595.slice/crio-9049a677a59495410c2c8eca26676cc12fffedb8beb7d9c63bdfaeaf5be2ba36 WatchSource:0}: Error finding container 9049a677a59495410c2c8eca26676cc12fffedb8beb7d9c63bdfaeaf5be2ba36: Status 404 returned error can't find the container with id 9049a677a59495410c2c8eca26676cc12fffedb8beb7d9c63bdfaeaf5be2ba36 Jul 08 16:34:19.434493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.434314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:19.434634 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.434504 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" Jul 08 16:34:19.434978 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.434938 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2418860c_84f5_443c_aac8_cee1470fe314.slice/crio-88978df4b9d6e545b523518e12b1b436239aab991f8aa0418e2c58a07776a428 WatchSource:0}: Error finding container 88978df4b9d6e545b523518e12b1b436239aab991f8aa0418e2c58a07776a428: Status 404 returned error can't find the container with id 88978df4b9d6e545b523518e12b1b436239aab991f8aa0418e2c58a07776a428 Jul 08 16:34:19.440566 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.440414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wnkqt" Jul 08 16:34:19.446324 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.446169 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzsz5" Jul 08 16:34:19.452969 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.452948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-826nj" Jul 08 16:34:19.457679 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.457651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" Jul 08 16:34:19.458305 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.458272 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bb9ce6_692c_4573_a534_0d17b0f87bea.slice/crio-14cd452d9c0d861660e69372dd5732aa9a913e28ed9fe74a2532d799b3034311 WatchSource:0}: Error finding container 14cd452d9c0d861660e69372dd5732aa9a913e28ed9fe74a2532d799b3034311: Status 404 returned error can't find the container with id 14cd452d9c0d861660e69372dd5732aa9a913e28ed9fe74a2532d799b3034311 Jul 08 16:34:19.462988 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.462708 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" Jul 08 16:34:19.473350 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.473317 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617927bf_79d1_4421_a466_f4174ba28b6a.slice/crio-0e96f3890a524fafa1fc5eca68d51ea6aed569a66209a0d91565a55277028063 WatchSource:0}: Error finding container 0e96f3890a524fafa1fc5eca68d51ea6aed569a66209a0d91565a55277028063: Status 404 returned error can't find the container with id 0e96f3890a524fafa1fc5eca68d51ea6aed569a66209a0d91565a55277028063 Jul 08 16:34:19.474004 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.473981 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95facfe2_602f_4673_a321_e9cbe2b6ba6d.slice/crio-01b38d550b7aaa64ba8a19db1397e36a93a9e70d2d665fdab06e1220acf20b2c WatchSource:0}: Error finding container 01b38d550b7aaa64ba8a19db1397e36a93a9e70d2d665fdab06e1220acf20b2c: Status 404 returned error can't find the container with id 01b38d550b7aaa64ba8a19db1397e36a93a9e70d2d665fdab06e1220acf20b2c Jul 08 16:34:19.480277 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:19.479720 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c45543_0832_4a4c_b780_1d83bd716200.slice/crio-9170d5fd09fe2ef35a0e00f7aa4e2c3709ecdea166b0d6d33112fc779869cabd WatchSource:0}: Error finding container 9170d5fd09fe2ef35a0e00f7aa4e2c3709ecdea166b0d6d33112fc779869cabd: Status 404 returned error can't find the container with id 9170d5fd09fe2ef35a0e00f7aa4e2c3709ecdea166b0d6d33112fc779869cabd Jul 08 16:34:19.524590 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.524556 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:19.735771 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.735737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:19.735951 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.735812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:19.735951 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.735928 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:19.736058 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.735934 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:19.736058 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.736012 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.735989203 +0000 UTC m=+4.017699258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:19.736058 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.736035 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.736024696 +0000 UTC m=+4.017734754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:19.836453 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:19.836414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:19.836703 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.836651 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:19.836703 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.836678 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:19.836703 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.836691 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:19.836927 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:19.836778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:20.836743178 +0000 UTC m=+4.118453234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:20.094266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.094184 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 16:34:20.181920 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.181847 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:19 +0000 UTC" deadline="2028-04-03 12:28:22.793389922 +0000 UTC" Jul 08 16:34:20.181920 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.181911 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15235h54m2.611482998s" Jul 08 16:34:20.335201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.335161 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:20.335370 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.335332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:20.348507 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.348416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerStarted","Data":"01b38d550b7aaa64ba8a19db1397e36a93a9e70d2d665fdab06e1220acf20b2c"} Jul 08 16:34:20.349801 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.349740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzsz5" event={"ID":"617927bf-79d1-4421-a466-f4174ba28b6a","Type":"ContainerStarted","Data":"0e96f3890a524fafa1fc5eca68d51ea6aed569a66209a0d91565a55277028063"} Jul 08 16:34:20.351255 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.351219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x4x5j" event={"ID":"451d0f44-1597-47cf-bde4-ab0795a84742","Type":"ContainerStarted","Data":"666617c78ae0caad6f6e49698358d900df51003777a8a30d9eeef497df5bf032"} Jul 08 16:34:20.352610 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.352570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j5562" event={"ID":"d61818f9-d863-4b87-9a65-ed69ae954595","Type":"ContainerStarted","Data":"9049a677a59495410c2c8eca26676cc12fffedb8beb7d9c63bdfaeaf5be2ba36"} Jul 08 16:34:20.354114 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.354087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" event={"ID":"a4c45543-0832-4a4c-b780-1d83bd716200","Type":"ContainerStarted","Data":"9170d5fd09fe2ef35a0e00f7aa4e2c3709ecdea166b0d6d33112fc779869cabd"} Jul 08 16:34:20.356049 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.356025 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-826nj" event={"ID":"ab19915c-b054-4a34-bfab-78a28e491357","Type":"ContainerStarted","Data":"80169d873a3cf3bae131fd7a0e2d273097731ac83033cb139a437dfa6f9e214e"} Jul 08 16:34:20.357263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.357239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wnkqt" event={"ID":"a8bb9ce6-692c-4573-a534-0d17b0f87bea","Type":"ContainerStarted","Data":"14cd452d9c0d861660e69372dd5732aa9a913e28ed9fe74a2532d799b3034311"} Jul 08 16:34:20.358630 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.358609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" event={"ID":"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc","Type":"ContainerStarted","Data":"0e66b70829c21e239f77ff6d1b0db7a0fb7f3e2e4f08f0ba958db182a0f4b45a"} Jul 08 16:34:20.360072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.360049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"88978df4b9d6e545b523518e12b1b436239aab991f8aa0418e2c58a07776a428"} Jul 08 16:34:20.746083 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.746044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:20.746263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.746113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:20.746263 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.746197 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:20.746400 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.746265 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:22.746244365 +0000 UTC m=+6.027954420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:20.746400 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.746296 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:20.746400 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.746365 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:22.746346861 +0000 UTC m=+6.028056912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:20.847187 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:20.846458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:20.847187 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.846705 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:20.847187 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.846728 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:20.847187 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.846761 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:20.847187 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:20.846824 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:22.846805383 +0000 UTC m=+6.128515439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:21.182324 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:21.182281 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 16:29:19 +0000 UTC" deadline="2027-12-26 11:22:12.622673831 +0000 UTC" Jul 08 16:34:21.182324 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:21.182319 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12858h47m51.440359443s" Jul 08 16:34:21.336437 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:21.335913 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:21.336437 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:21.336059 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:21.336437 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:21.336107 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:21.336437 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:21.336235 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:22.335036 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:22.334836 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:22.335036 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.334980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:22.762142 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:22.762108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:22.762383 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:22.762168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:22.762383 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.762328 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:22.762504 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.762385 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:22.762504 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.762389 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:26.76237206 +0000 UTC m=+10.044082109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:22.762504 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.762430 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:26.762419504 +0000 UTC m=+10.044129558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:22.863076 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:22.863014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:22.863317 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.863232 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:22.863317 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.863252 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:22.863317 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.863264 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:22.863317 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:22.863318 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:26.863301305 +0000 UTC m=+10.145011355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:23.338438 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:23.338404 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:23.338924 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:23.338535 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:23.338984 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:23.338933 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:23.341031 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:23.339028 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:24.335066 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:24.334811 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:24.335066 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:24.334959 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:25.334850 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:25.334821 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:25.335311 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:25.334948 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:25.337766 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:25.337570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:25.337766 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:25.337673 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:26.334762 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:26.334734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:26.334911 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.334870 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:26.797298 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:26.797234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:26.797568 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:26.797308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:26.797568 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.797416 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:26.797568 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.797438 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:26.797568 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.797496 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:34.797477516 +0000 UTC m=+18.079187570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:26.797568 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.797516 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:34.79750587 +0000 UTC m=+18.079215924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:26.897887 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:26.897852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:26.898076 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.898052 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:26.898142 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.898083 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:26.898142 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.898098 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:26.898234 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:26.898163 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:34.898144511 +0000 UTC m=+18.179854583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:27.335490 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:27.335459 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:27.335873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:27.335570 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:27.335873 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:27.335615 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:27.335873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:27.335720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:28.335178 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:28.335014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:28.335178 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:28.335135 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:29.335431 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:29.335219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:29.335431 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:29.335349 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:29.335431 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:29.335381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:29.335984 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:29.335444 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:30.335140 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:30.334917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:30.335274 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:30.335250 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:30.388018 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:30.387948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" event={"ID":"6f2742cb3cdbcf3416c4ac6825708c8f","Type":"ContainerStarted","Data":"93ba9a0fe103718a149c7de088c6f74aba1fcffd5bbd9d6246915c6e10bd5c34"} Jul 08 16:34:30.391059 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:30.390643 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" event={"ID":"a4c45543-0832-4a4c-b780-1d83bd716200","Type":"ContainerStarted","Data":"2891cb62ce7024ff9cbdccee601593184c3cf5dd44b67010273b73f8fdc3ad40"} Jul 08 16:34:30.404650 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:30.404348 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-45.ec2.internal" podStartSLOduration=12.404330895 podStartE2EDuration="12.404330895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:30.404065206 +0000 UTC m=+13.685775277" watchObservedRunningTime="2026-07-08 16:34:30.404330895 +0000 UTC m=+13.686040967" Jul 08 16:34:30.423637 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:30.423541 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zqvsk" podStartSLOduration=2.766344086 podStartE2EDuration="13.423523156s" totalImagesPullingTime="10.65717907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:30.42333749 +0000 UTC m=+13.705047563" watchObservedRunningTime="2026-07-08 16:34:30.423523156 +0000 UTC m=+13.705233230" Jul 08 16:34:31.335486 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:31.335391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:31.335486 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:31.335437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:31.335680 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:31.335522 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:31.335680 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:31.335649 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:32.334532 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.334505 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:32.335242 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:32.334635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:32.397749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.397685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzsz5" event={"ID":"617927bf-79d1-4421-a466-f4174ba28b6a","Type":"ContainerStarted","Data":"1177e6e1cc5777ce3f99c796ef08c927d67632a41065633537316f040b105934"} Jul 08 16:34:32.399323 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.399295 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x4x5j" event={"ID":"451d0f44-1597-47cf-bde4-ab0795a84742","Type":"ContainerStarted","Data":"7bb7a83872af9e6ec62d67f513c3bc2233c735624c0d7399a9880282c21b91c1"} Jul 08 16:34:32.400860 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.400834 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j5562" event={"ID":"d61818f9-d863-4b87-9a65-ed69ae954595","Type":"ContainerStarted","Data":"5bf8f270c436f496819d5f528885d3dd0a05bbad7df86081833b3fba9dcfb9f4"} Jul 08 16:34:32.402399 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.402370 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"2cf3b9a3cd42a58e6a7720c3110882b5","Type":"ContainerStarted","Data":"28bfd2e1dedd49f9516eccc7f677ae4f2653119ef04185b8d91bfa4d3ea4b0e0"} Jul 08 16:34:32.404008 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.403985 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-826nj" event={"ID":"ab19915c-b054-4a34-bfab-78a28e491357","Type":"ContainerStarted","Data":"4774c12bd422a0e20bfedcb88587b614a84438926562aa375f0fd86bdccaad98"} Jul 08 16:34:32.405480 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.405458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" event={"ID":"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc","Type":"ContainerStarted","Data":"1cfd997592d0ef24ecc4f252274eedabc644db9845486b056c635687f9244697"} Jul 08 16:34:32.406913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.406890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerStarted","Data":"5ba8d758b93b859a34c434431f9375d471ce63958e2877f660e80db1999c3696"} Jul 08 16:34:32.413917 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.413846 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rzsz5" podStartSLOduration=5.030776951 podStartE2EDuration="15.413833633s" totalImagesPullingTime="10.383056682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:32.413240436 +0000 UTC m=+15.694950507" watchObservedRunningTime="2026-07-08 16:34:32.413833633 +0000 UTC m=+15.695543758" Jul 08 16:34:32.466514 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.466464 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x4x5j" podStartSLOduration=5.090442357 podStartE2EDuration="15.466448545s" totalImagesPullingTime="10.376006188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:32.46631444 +0000 UTC m=+15.748024511" watchObservedRunningTime="2026-07-08 16:34:32.466448545 +0000 UTC m=+15.748158616" Jul 08 16:34:32.466987 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.466950 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j5562" podStartSLOduration=4.984032257 podStartE2EDuration="15.466936784s" totalImagesPullingTime="10.482904527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:32.451815731 +0000 UTC m=+15.733525805" watchObservedRunningTime="2026-07-08 16:34:32.466936784 +0000 UTC m=+15.748646854" Jul 08 16:34:32.479799 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:32.479755 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-826nj" podStartSLOduration=5.047210307 podStartE2EDuration="15.479739386s" totalImagesPullingTime="10.432529079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:32.479234641 +0000 UTC m=+15.760944714" watchObservedRunningTime="2026-07-08 16:34:32.479739386 +0000 UTC m=+15.761449459" Jul 08 16:34:33.334724 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:33.334677 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:33.334724 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:33.334718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:33.335268 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:33.334828 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:33.335268 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:33.335039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:34.223400 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.223368 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:34.224121 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.224103 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:34.335069 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.335036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:34.335515 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.335152 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:34.410783 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.410741 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:34.411259 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.411227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x4x5j" Jul 08 16:34:34.857645 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.857444 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:34.857645 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.857626 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:34.857877 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.857669 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:34.857877 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.857699 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.857683101 +0000 UTC m=+34.139393149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:34.857877 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.857761 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:34.857877 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.857818 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.85780174 +0000 UTC m=+34.139511790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:34.958315 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:34.958275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:34.958495 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.958459 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:34.958495 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.958480 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:34.958495 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.958489 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:34.958613 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:34.958547 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:50.958528885 +0000 UTC m=+34.240238934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:35.334797 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:35.334682 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:35.334797 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:35.334745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:35.334960 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:35.334822 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:35.334960 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:35.334933 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:36.334365 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:36.334329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:36.334877 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:36.334478 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:36.416461 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:36.416430 2577 generic.go:356] "Generic (PLEG): container finished" podID="2cf3b9a3cd42a58e6a7720c3110882b5" containerID="28bfd2e1dedd49f9516eccc7f677ae4f2653119ef04185b8d91bfa4d3ea4b0e0" exitCode=0 Jul 08 16:34:36.416635 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:36.416503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"2cf3b9a3cd42a58e6a7720c3110882b5","Type":"ContainerDied","Data":"28bfd2e1dedd49f9516eccc7f677ae4f2653119ef04185b8d91bfa4d3ea4b0e0"} Jul 08 16:34:36.418435 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:36.418412 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="5ba8d758b93b859a34c434431f9375d471ce63958e2877f660e80db1999c3696" exitCode=0 Jul 08 16:34:36.418529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:36.418476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"5ba8d758b93b859a34c434431f9375d471ce63958e2877f660e80db1999c3696"} Jul 08 16:34:37.335946 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:37.335863 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:37.336401 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:37.335985 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:37.336401 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:37.336017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:37.336401 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:37.336083 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:38.334571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:38.334536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:38.334756 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:38.334665 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:39.334953 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.334516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:39.334953 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.334516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:39.334953 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:39.334634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:39.334953 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:39.334728 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:39.429192 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.429154 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" event={"ID":"2cf3b9a3cd42a58e6a7720c3110882b5","Type":"ContainerStarted","Data":"79b739ed3aaaf6c134f872ce5d6e9197cfa08f45008cb83cc9232e4f1c4bb15b"} Jul 08 16:34:39.431954 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.431925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wnkqt" event={"ID":"a8bb9ce6-692c-4573-a534-0d17b0f87bea","Type":"ContainerStarted","Data":"f0f13c0e4d56ef21dfcb6d7ec79cb373756a71e7e5d831812af1c460b372d2a3"} Jul 08 16:34:39.434754 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.434694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"f25ac668a4abd670e4481ed6bcbd8a4ea10cfa4a8be64ae74c2f0115f648a9fb"} Jul 08 16:34:39.446375 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.446008 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 16:34:39.463635 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.463437 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wnkqt" podStartSLOduration=2.621666654 podStartE2EDuration="22.463416386s" totalImagesPullingTime="19.841749732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:39.463145494 +0000 UTC m=+22.744855569" watchObservedRunningTime="2026-07-08 16:34:39.463416386 +0000 UTC m=+22.745126458" Jul 08 16:34:39.464425 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:39.464383 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-45.ec2.internal" podStartSLOduration=21.464366627 podStartE2EDuration="21.464366627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:39.445031441 +0000 UTC m=+22.726741516" watchObservedRunningTime="2026-07-08 16:34:39.464366627 +0000 UTC m=+22.746076698" Jul 08 16:34:40.191204 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.191058 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T16:34:39.446023125Z","UUID":"952095c0-1700-4395-b257-9e755ed5adfc","Handler":null,"Name":"","Endpoint":""} Jul 08 16:34:40.192338 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.192317 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 16:34:40.192418 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.192354 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 16:34:40.334463 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.334429 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:40.334681 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:40.334545 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:40.439585 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.439547 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" event={"ID":"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc","Type":"ContainerStarted","Data":"71b18a5bfe1672d904b739d8d63fc604e1fae6b4a44dcc93bd13302a6b97142f"} Jul 08 16:34:40.443271 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.443197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"0f3a4c5b44a4348d36ae0f9ac02c8b131bc092436e2bf919a33d512640375b4b"} Jul 08 16:34:40.443271 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.443262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"8012528dae20a1d909d29c0d80f7aab27443ed9b63167ae7e41a351a886699d2"} Jul 08 16:34:40.443442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.443308 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"dc44d0fa73ecdbcf643f114f373b02dd5b0639b4b936a41a24c1f01eed535526"} Jul 08 16:34:40.443442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.443361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"7cf1160114d9da502a0708b29c7d5930cd4fcdb944310dffec6b6ce01c190bc2"} Jul 08 16:34:40.443442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:40.443413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"1e93176044ccf7cda46d788992561dcb13a1e77c78c95cc88bd18ed90d454b15"} Jul 08 16:34:41.334967 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:41.334829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:41.335168 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:41.334962 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:41.335168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:41.335028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:41.335168 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:41.335123 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:41.447655 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:41.447619 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" event={"ID":"52bef0d8-e845-4bb3-8fb2-41cbbec8d9dc","Type":"ContainerStarted","Data":"6554ecfbb8a415ab6a3283d5dfd7210f97e029d0ba31315afa30fbcb7384e1c1"} Jul 08 16:34:42.334449 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:42.334408 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:42.334611 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:42.334537 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:42.454641 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:42.454606 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"326b19a44c4c88be0491cde77cebff2bc9134522dfb1ea1e46c1f9f7f92e392c"} Jul 08 16:34:43.335403 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:43.335366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:43.335574 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:43.335419 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:43.335574 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:43.335506 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:43.335690 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:43.335637 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:44.334752 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:44.334673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:44.335116 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:44.334808 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:45.335468 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.335239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:45.335906 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.335247 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:45.335906 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:45.335497 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:45.335906 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:45.335571 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:45.464620 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.464585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" event={"ID":"2418860c-84f5-443c-aac8-cee1470fe314","Type":"ContainerStarted","Data":"4a116b7ebcaf29e6a563c6a0e553f0d56784eeb50bc08bacf02582c15da4d8bd"} Jul 08 16:34:45.464908 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.464885 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:45.466486 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.466462 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="34659199af147d55332898bbf9f5e37652f120785c0f9eea2bf49f68e8ddbefd" exitCode=0 Jul 08 16:34:45.466578 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.466515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"34659199af147d55332898bbf9f5e37652f120785c0f9eea2bf49f68e8ddbefd"} Jul 08 16:34:45.480809 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.480789 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:45.492217 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.492151 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" podStartSLOduration=8.622303469 podStartE2EDuration="28.492133295s" totalImagesPullingTime="19.869829826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:45.491261914 +0000 UTC m=+28.772971985" watchObservedRunningTime="2026-07-08 16:34:45.492133295 +0000 UTC m=+28.773843370" Jul 08 16:34:45.492663 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:45.492621 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9xfz6" podStartSLOduration=8.588889174 podStartE2EDuration="28.492612624s" totalImagesPullingTime="19.90372345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:41.481083825 +0000 UTC m=+24.762793887" watchObservedRunningTime="2026-07-08 16:34:45.492612624 +0000 UTC m=+28.774322698" Jul 08 16:34:46.335316 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:46.335285 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:46.335491 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:46.335396 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:46.469212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:46.469185 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:46.469359 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:46.469272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:46.483174 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:46.483145 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:34:47.080835 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.080562 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d59t8"] Jul 08 16:34:47.081031 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.081014 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:47.081183 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:47.081154 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:47.083400 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.083375 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5c5x4"] Jul 08 16:34:47.083507 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.083468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:47.083559 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:47.083542 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:47.092942 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.092914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n8gml"] Jul 08 16:34:47.093042 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.093004 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:47.093096 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:47.093078 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:47.472573 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.472531 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="59aa118bb5594379318785f69d7c155ea5007f712f2adb453c256fc25ae258aa" exitCode=0 Jul 08 16:34:47.473081 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:47.472618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"59aa118bb5594379318785f69d7c155ea5007f712f2adb453c256fc25ae258aa"} Jul 08 16:34:48.334850 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:48.334779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:48.335026 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:48.334907 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:49.334911 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:49.334872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:49.335598 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:49.334992 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:49.335598 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:49.335028 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:49.335598 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:49.335082 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:49.480035 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:49.480001 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="e0031080bc199372f6bca8a202fd017b28f28fb5732fe9acc927a1369bf9aedc" exitCode=0 Jul 08 16:34:49.480035 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:49.480038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"e0031080bc199372f6bca8a202fd017b28f28fb5732fe9acc927a1369bf9aedc"} Jul 08 16:34:50.334354 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:50.334325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:50.334506 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.334452 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8gml" podUID="b4bff7c4-503c-465b-a028-1f48a7318748" Jul 08 16:34:50.877786 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:50.877746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:50.878243 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:50.877798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:50.878243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.877907 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:50.878243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.877917 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:50.878243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.877981 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:22.877958751 +0000 UTC m=+66.159668806 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 16:34:50.878243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.878003 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret podName:096d2ce7-f666-481f-a7a7-03bbab8947f2 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:22.877994038 +0000 UTC m=+66.159704087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret") pod "global-pull-secret-syncer-d59t8" (UID: "096d2ce7-f666-481f-a7a7-03bbab8947f2") : object "kube-system"/"original-pull-secret" not registered Jul 08 16:34:50.979136 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:50.979096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:50.979317 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.979292 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 16:34:50.979363 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.979321 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 16:34:50.979363 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.979335 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vr42f for pod openshift-network-diagnostics/network-check-target-5c5x4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:50.979458 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:50.979402 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f podName:c907588d-0c5d-452e-92b6-a89b25ea9fb5 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:22.979383826 +0000 UTC m=+66.261093883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vr42f" (UniqueName: "kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f") pod "network-check-target-5c5x4" (UID: "c907588d-0c5d-452e-92b6-a89b25ea9fb5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 16:34:51.334517 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.334426 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:51.334692 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.334427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:51.334692 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:51.334554 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d59t8" podUID="096d2ce7-f666-481f-a7a7-03bbab8947f2" Jul 08 16:34:51.334692 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:51.334614 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5c5x4" podUID="c907588d-0c5d-452e-92b6-a89b25ea9fb5" Jul 08 16:34:51.930273 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.930238 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-45.ec2.internal" event="NodeReady" Jul 08 16:34:51.930667 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.930398 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 16:34:51.976527 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.976247 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgh8"] Jul 08 16:34:51.978890 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.978857 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:51.979031 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.978895 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tj766"] Jul 08 16:34:51.980862 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.980832 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s64wv\"" Jul 08 16:34:51.980862 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.980851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 16:34:51.981071 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.980902 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 16:34:51.981071 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.980911 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 16:34:51.981168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.981085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj766" Jul 08 16:34:51.983108 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.983092 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 16:34:51.983205 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.983133 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 16:34:51.983263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.983229 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rv4r\"" Jul 08 16:34:51.990345 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.990199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgh8"] Jul 08 16:34:51.992958 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:51.992938 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj766"] Jul 08 16:34:52.086927 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.086895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6mc\" (UniqueName: \"kubernetes.io/projected/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-kube-api-access-mt6mc\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.087100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.086945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a81626-2dd9-4629-b625-f9cb41340f67-config-volume\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.087100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.087032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.087100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.087075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7a81626-2dd9-4629-b625-f9cb41340f67-tmp-dir\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.087218 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.087103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jx2l\" (UniqueName: \"kubernetes.io/projected/a7a81626-2dd9-4629-b625-f9cb41340f67-kube-api-access-9jx2l\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.087218 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.087145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-cert\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.188025 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.187993 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7a81626-2dd9-4629-b625-f9cb41340f67-tmp-dir\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.188025 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jx2l\" (UniqueName: \"kubernetes.io/projected/a7a81626-2dd9-4629-b625-f9cb41340f67-kube-api-access-9jx2l\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.188253 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-cert\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.188340 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6mc\" (UniqueName: \"kubernetes.io/projected/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-kube-api-access-mt6mc\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.188398 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188341 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7a81626-2dd9-4629-b625-f9cb41340f67-tmp-dir\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.188398 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188374 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a81626-2dd9-4629-b625-f9cb41340f67-config-volume\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.188489 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188416 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.188541 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:52.188501 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:34:52.188591 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:52.188550 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:52.688536271 +0000 UTC m=+35.970246321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:34:52.188940 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.188914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a81626-2dd9-4629-b625-f9cb41340f67-config-volume\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.192861 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.192838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-cert\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.202369 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.202350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6mc\" (UniqueName: \"kubernetes.io/projected/2b2ada3b-fe81-49bb-9c37-60e2fd4406cb-kube-api-access-mt6mc\") pod \"ingress-canary-hmgh8\" (UID: \"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb\") " pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.203867 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.203840 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jx2l\" (UniqueName: \"kubernetes.io/projected/a7a81626-2dd9-4629-b625-f9cb41340f67-kube-api-access-9jx2l\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.291088 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.291013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmgh8" Jul 08 16:34:52.335135 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.335100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:34:52.338062 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.338029 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:34:52.338236 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.338215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwzcp\"" Jul 08 16:34:52.693151 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:52.693113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:52.693348 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:52.693278 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:34:52.693348 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:52.693342 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:53.693327956 +0000 UTC m=+36.975038006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:34:53.334341 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.334297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:34:53.334817 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.334494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:34:53.336863 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.336843 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:34:53.337458 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.337430 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:34:53.337551 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.337530 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wkjp\"" Jul 08 16:34:53.337635 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.337431 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:34:53.628944 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.628919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmgh8"] Jul 08 16:34:53.633037 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:34:53.633013 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b2ada3b_fe81_49bb_9c37_60e2fd4406cb.slice/crio-275b172e47cc83f8ade29fa6cb6e9ffa9ace2b8c617e08c2a1407f9018a66f8d WatchSource:0}: Error finding container 275b172e47cc83f8ade29fa6cb6e9ffa9ace2b8c617e08c2a1407f9018a66f8d: Status 404 returned error can't find the container with id 275b172e47cc83f8ade29fa6cb6e9ffa9ace2b8c617e08c2a1407f9018a66f8d Jul 08 16:34:53.702806 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:53.702766 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:53.702972 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:53.702906 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:34:53.702972 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:53.702971 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:55.70295443 +0000 UTC m=+38.984664480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:34:54.493690 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:54.493649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmgh8" event={"ID":"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb","Type":"ContainerStarted","Data":"275b172e47cc83f8ade29fa6cb6e9ffa9ace2b8c617e08c2a1407f9018a66f8d"} Jul 08 16:34:54.496840 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:54.496813 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="d6aa4815f6fc8fd39e1cb6b1579c4c073896eaf82117e90cc82053945ffa19fe" exitCode=0 Jul 08 16:34:54.496984 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:54.496849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"d6aa4815f6fc8fd39e1cb6b1579c4c073896eaf82117e90cc82053945ffa19fe"} Jul 08 16:34:55.503428 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:55.503250 2577 generic.go:356] "Generic (PLEG): container finished" podID="95facfe2-602f-4673-a321-e9cbe2b6ba6d" containerID="5c7dfe0968a02d06be41817ef17521eefa3f9182ac3f77fc97afd18e662058c3" exitCode=0 Jul 08 16:34:55.503832 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:55.503316 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerDied","Data":"5c7dfe0968a02d06be41817ef17521eefa3f9182ac3f77fc97afd18e662058c3"} Jul 08 16:34:55.716247 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:55.716208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:55.716418 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:55.716393 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:34:55.716485 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:55.716469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:34:59.716450027 +0000 UTC m=+42.998160076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:34:56.506844 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:56.506817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmgh8" event={"ID":"2b2ada3b-fe81-49bb-9c37-60e2fd4406cb","Type":"ContainerStarted","Data":"cceb810db6c367083360281def6c6fa14f1116347683aea7e7746ef08150aeef"} Jul 08 16:34:56.509916 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:56.509896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" event={"ID":"95facfe2-602f-4673-a321-e9cbe2b6ba6d","Type":"ContainerStarted","Data":"dd9a071402cef7ecdda6d419cb9a60465f698e8472e87b5bf958d7e9e5d9090e"} Jul 08 16:34:56.531491 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:56.531451 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hmgh8" podStartSLOduration=3.23452535 podStartE2EDuration="5.531437321s" totalImagesPullingTime="2.296911971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:56.530485561 +0000 UTC m=+39.812195632" watchObservedRunningTime="2026-07-08 16:34:56.531437321 +0000 UTC m=+39.813147391" Jul 08 16:34:56.557104 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:56.557065 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8jf8m" podStartSLOduration=14.372550144 podStartE2EDuration="39.557050328s" totalImagesPullingTime="25.184500184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:34:56.556275788 +0000 UTC m=+39.837985858" watchObservedRunningTime="2026-07-08 16:34:56.557050328 +0000 UTC m=+39.838760398" Jul 08 16:34:59.746313 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:34:59.746268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:34:59.746892 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:59.746390 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:34:59.746892 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:34:59.746446 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:07.746430927 +0000 UTC m=+51.028140978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:35:07.530456 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.530424 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4"] Jul 08 16:35:07.541286 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.541248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.544817 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.544793 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nbq7b\"" Jul 08 16:35:07.544817 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.544800 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 16:35:07.546131 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.546113 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 16:35:07.546131 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.546123 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 16:35:07.546272 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.546137 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 16:35:07.549595 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.549573 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4"] Jul 08 16:35:07.704326 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.704289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/444b53cb-5891-4499-a486-b733e68e21b9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.704516 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.704339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.704516 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.704423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpvp7\" (UniqueName: \"kubernetes.io/projected/444b53cb-5891-4499-a486-b733e68e21b9-kube-api-access-xpvp7\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.805642 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.805559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/444b53cb-5891-4499-a486-b733e68e21b9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.805642 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.805606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.805873 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.805649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:35:07.805873 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.805666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvp7\" (UniqueName: \"kubernetes.io/projected/444b53cb-5891-4499-a486-b733e68e21b9-kube-api-access-xpvp7\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.805873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:07.805803 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:07.806011 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:07.805806 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:07.806011 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:07.805908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.805888972 +0000 UTC m=+67.087599040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:35:07.806011 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:07.805962 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.305941104 +0000 UTC m=+51.587651154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:07.806279 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.806262 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/444b53cb-5891-4499-a486-b733e68e21b9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.820799 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.820779 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gs2hb"] Jul 08 16:35:07.833996 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.833973 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvp7\" (UniqueName: \"kubernetes.io/projected/444b53cb-5891-4499-a486-b733e68e21b9-kube-api-access-xpvp7\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:07.845335 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.845316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:07.848758 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.848722 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 16:35:07.848895 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.848878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 16:35:07.849051 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.849036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fkl4f\"" Jul 08 16:35:07.849459 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.849445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:35:07.855054 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.855035 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gs2hb"] Jul 08 16:35:07.870960 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.870935 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 16:35:07.874605 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.874590 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 16:35:07.898129 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.898101 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c59f7dd88-lj2rp"] Jul 08 16:35:07.921968 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.921942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:07.934465 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.934450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 16:35:07.936766 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.936748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 16:35:07.936900 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.936886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 16:35:07.936994 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.936978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-746tn\"" Jul 08 16:35:07.952973 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.952945 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c59f7dd88-lj2rp"] Jul 08 16:35:07.953263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:07.953238 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 16:35:08.006762 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.006724 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-trusted-ca\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.006912 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.006795 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-config\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.006912 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.006815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-serving-cert\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.006912 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.006866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwlb\" (UniqueName: \"kubernetes.io/projected/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-kube-api-access-xlwlb\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.108078 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwlb\" (UniqueName: \"kubernetes.io/projected/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-kube-api-access-xlwlb\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-trusted-ca\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.108529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-config\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.108529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108435 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-serving-cert\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.108529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108465 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.108529 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.108498 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5dvl\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.109063 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.109042 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-config\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.109242 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.109225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-trusted-ca\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.110662 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.110642 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-serving-cert\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.122226 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.122197 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwlb\" (UniqueName: \"kubernetes.io/projected/5a2fd05f-50f1-4a1d-bd27-efe9892427c9-kube-api-access-xlwlb\") pod \"console-operator-68b757fb67-gs2hb\" (UID: \"5a2fd05f-50f1-4a1d-bd27-efe9892427c9\") " pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.155072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.155047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:08.209112 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209266 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.209241 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:08.209424 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.209272 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:08.209424 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.209327 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:08.70930937 +0000 UTC m=+51.991019444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:08.209424 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209520 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209565 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5dvl\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.209888 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.210001 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.209897 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.210338 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.210314 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.211526 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.211502 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.211631 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.211612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.223020 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.222995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.223250 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.223229 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5dvl\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.292928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.292892 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gs2hb"] Jul 08 16:35:08.296011 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:08.295979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2fd05f_50f1_4a1d_bd27_efe9892427c9.slice/crio-e10da8d3261fccfc640a34901e13c07d230277890576cd17d58660caa9b3b801 WatchSource:0}: Error finding container e10da8d3261fccfc640a34901e13c07d230277890576cd17d58660caa9b3b801: Status 404 returned error can't find the container with id e10da8d3261fccfc640a34901e13c07d230277890576cd17d58660caa9b3b801 Jul 08 16:35:08.310208 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.310186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:08.310338 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.310320 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:08.310389 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.310378 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.310363469 +0000 UTC m=+52.592073519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:08.540245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.540161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" event={"ID":"5a2fd05f-50f1-4a1d-bd27-efe9892427c9","Type":"ContainerStarted","Data":"e10da8d3261fccfc640a34901e13c07d230277890576cd17d58660caa9b3b801"} Jul 08 16:35:08.712937 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:08.712889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:08.713108 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.713004 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:08.713108 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.713023 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:08.713108 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:08.713078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:09.713064186 +0000 UTC m=+52.994774239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:09.316752 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:09.316692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:09.316906 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:09.316857 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:09.316947 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:09.316932 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:11.316915235 +0000 UTC m=+54.598625299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:09.718753 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:09.718721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:09.719203 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:09.718873 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:09.719203 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:09.718888 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:09.719203 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:09.718942 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:11.718925887 +0000 UTC m=+55.000635942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:11.330267 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.330234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:11.330617 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:11.330382 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:11.330617 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:11.330449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:15.330433811 +0000 UTC m=+58.612143860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:11.549052 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.549026 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/0.log" Jul 08 16:35:11.549207 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.549066 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a2fd05f-50f1-4a1d-bd27-efe9892427c9" containerID="f35ca954b64d7e6e3c292c876a3855851506df5c9fb73a71a52b71039c79f7b5" exitCode=255 Jul 08 16:35:11.549207 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.549105 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" event={"ID":"5a2fd05f-50f1-4a1d-bd27-efe9892427c9","Type":"ContainerDied","Data":"f35ca954b64d7e6e3c292c876a3855851506df5c9fb73a71a52b71039c79f7b5"} Jul 08 16:35:11.549333 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.549319 2577 scope.go:117] "RemoveContainer" containerID="f35ca954b64d7e6e3c292c876a3855851506df5c9fb73a71a52b71039c79f7b5" Jul 08 16:35:11.733282 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:11.733237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:11.733450 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:11.733363 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:11.733450 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:11.733375 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:11.733450 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:11.733425 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:15.733412002 +0000 UTC m=+59.015122051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:12.553114 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553086 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:35:12.553539 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553490 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/0.log" Jul 08 16:35:12.553539 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553530 2577 generic.go:356] "Generic (PLEG): container finished" podID="5a2fd05f-50f1-4a1d-bd27-efe9892427c9" containerID="2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26" exitCode=255 Jul 08 16:35:12.553658 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" event={"ID":"5a2fd05f-50f1-4a1d-bd27-efe9892427c9","Type":"ContainerDied","Data":"2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26"} Jul 08 16:35:12.553731 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553687 2577 scope.go:117] "RemoveContainer" containerID="f35ca954b64d7e6e3c292c876a3855851506df5c9fb73a71a52b71039c79f7b5" Jul 08 16:35:12.553908 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:12.553892 2577 scope.go:117] "RemoveContainer" containerID="2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26" Jul 08 16:35:12.554092 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:12.554066 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gs2hb_openshift-console-operator(5a2fd05f-50f1-4a1d-bd27-efe9892427c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" podUID="5a2fd05f-50f1-4a1d-bd27-efe9892427c9" Jul 08 16:35:13.557103 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:13.557075 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:35:13.557477 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:13.557383 2577 scope.go:117] "RemoveContainer" containerID="2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26" Jul 08 16:35:13.557531 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:13.557512 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gs2hb_openshift-console-operator(5a2fd05f-50f1-4a1d-bd27-efe9892427c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" podUID="5a2fd05f-50f1-4a1d-bd27-efe9892427c9" Jul 08 16:35:15.359882 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.359850 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:15.360255 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.359991 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:15.360255 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.360047 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.360032914 +0000 UTC m=+66.641742963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:15.381472 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.381445 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s4zqn"] Jul 08 16:35:15.384480 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.384466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.386382 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.386357 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 16:35:15.386549 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.386452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 16:35:15.386549 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.386452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 16:35:15.386549 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.386480 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 16:35:15.386997 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.386981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-82p44\"" Jul 08 16:35:15.395263 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.395244 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4zqn"] Jul 08 16:35:15.460133 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.460093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ff73140-abdc-441c-8b1b-537e13f6c68e-crio-socket\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.460306 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.460201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.460306 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.460250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp699\" (UniqueName: \"kubernetes.io/projected/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-api-access-rp699\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.460306 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.460281 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ff73140-abdc-441c-8b1b-537e13f6c68e-data-volume\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.460430 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.460323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.560675 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.560648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.560862 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.560682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp699\" (UniqueName: \"kubernetes.io/projected/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-api-access-rp699\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.560862 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.560790 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:15.560949 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.560880 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:16.060857139 +0000 UTC m=+59.342567215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : configmap "kube-rbac-proxy" not found Jul 08 16:35:15.560949 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.560901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ff73140-abdc-441c-8b1b-537e13f6c68e-data-volume\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.560949 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.560936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.561087 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.560986 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ff73140-abdc-441c-8b1b-537e13f6c68e-crio-socket\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.561142 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.561093 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:15.561142 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.561129 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ff73140-abdc-441c-8b1b-537e13f6c68e-crio-socket\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.561231 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.561164 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:16.061135686 +0000 UTC m=+59.342845740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:15.561293 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.561277 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ff73140-abdc-441c-8b1b-537e13f6c68e-data-volume\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.570289 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.570266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp699\" (UniqueName: \"kubernetes.io/projected/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-api-access-rp699\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:15.762682 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:15.762581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:15.762839 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.762721 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:15.762839 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.762735 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:15.762839 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:15.762800 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.762786198 +0000 UTC m=+67.044496247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:16.065576 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:16.065469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:16.065576 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:16.065541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:16.065790 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:16.065627 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:16.065790 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:16.065642 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:16.065790 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:16.065694 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:17.0656789 +0000 UTC m=+60.347388950 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:16.065790 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:16.065733 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:17.065722624 +0000 UTC m=+60.347432675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : configmap "kube-rbac-proxy" not found Jul 08 16:35:17.074475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:17.074437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:17.074873 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:17.074497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:17.074873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:17.074568 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:17.074873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:17.074616 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:17.074873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:17.074637 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.074621656 +0000 UTC m=+62.356331706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : configmap "kube-rbac-proxy" not found Jul 08 16:35:17.074873 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:17.074655 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:19.074644084 +0000 UTC m=+62.356354133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:18.156132 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:18.156093 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:18.156609 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:18.156168 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:18.156609 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:18.156466 2577 scope.go:117] "RemoveContainer" containerID="2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26" Jul 08 16:35:18.156609 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:18.156601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gs2hb_openshift-console-operator(5a2fd05f-50f1-4a1d-bd27-efe9892427c9)\"" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" podUID="5a2fd05f-50f1-4a1d-bd27-efe9892427c9" Jul 08 16:35:18.167853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:18.167827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j5562_d61818f9-d863-4b87-9a65-ed69ae954595/dns-node-resolver/0.log" Jul 08 16:35:18.486374 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:18.486299 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lthzr" Jul 08 16:35:19.091027 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:19.090973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:19.091242 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:19.091119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:19.091242 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:19.091124 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:19.091242 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:19.091159 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:19.091242 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:19.091230 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.091212652 +0000 UTC m=+66.372922700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:19.091454 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:19.091251 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:23.091239947 +0000 UTC m=+66.372949997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : configmap "kube-rbac-proxy" not found Jul 08 16:35:19.165094 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:19.165067 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzsz5_617927bf-79d1-4421-a466-f4174ba28b6a/node-ca/0.log" Jul 08 16:35:19.963659 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:19.963630 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmgh8_2b2ada3b-fe81-49bb-9c37-60e2fd4406cb/serve-healthcheck-canary/0.log" Jul 08 16:35:22.919658 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:22.919622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:35:22.920051 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:22.919680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:35:22.922036 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:22.922014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 16:35:22.922129 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:22.922049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 16:35:22.929856 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:22.929835 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 16:35:22.929950 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:22.929890 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs podName:b4bff7c4-503c-465b-a028-1f48a7318748 nodeName:}" failed. No retries permitted until 2026-07-08 16:36:26.929876266 +0000 UTC m=+130.211586316 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs") pod "network-metrics-daemon-n8gml" (UID: "b4bff7c4-503c-465b-a028-1f48a7318748") : secret "metrics-daemon-secret" not found Jul 08 16:35:22.931924 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:22.931903 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/096d2ce7-f666-481f-a7a7-03bbab8947f2-original-pull-secret\") pod \"global-pull-secret-syncer-d59t8\" (UID: \"096d2ce7-f666-481f-a7a7-03bbab8947f2\") " pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:35:23.020352 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.020316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:35:23.022846 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.022829 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 16:35:23.032630 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.032611 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 16:35:23.043636 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.043615 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr42f\" (UniqueName: \"kubernetes.io/projected/c907588d-0c5d-452e-92b6-a89b25ea9fb5-kube-api-access-vr42f\") pod \"network-check-target-5c5x4\" (UID: \"c907588d-0c5d-452e-92b6-a89b25ea9fb5\") " pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:35:23.048393 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.048375 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d59t8" Jul 08 16:35:23.057531 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.057514 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9wkjp\"" Jul 08 16:35:23.064072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.064054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:35:23.121377 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.121288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:23.121377 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.121357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:23.121567 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.121541 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 16:35:23.121567 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.121565 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:23.121679 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.121616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:31.121596256 +0000 UTC m=+74.403306304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:23.121679 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.121634 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:31.121624144 +0000 UTC m=+74.403334193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : configmap "kube-rbac-proxy" not found Jul 08 16:35:23.181272 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.181192 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d59t8"] Jul 08 16:35:23.184588 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:23.184567 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096d2ce7_f666_481f_a7a7_03bbab8947f2.slice/crio-6e1e4435ca5a1e4fe2f5cbb5a1b0de9a0957d1c941e0f463795fdedcb072dc94 WatchSource:0}: Error finding container 6e1e4435ca5a1e4fe2f5cbb5a1b0de9a0957d1c941e0f463795fdedcb072dc94: Status 404 returned error can't find the container with id 6e1e4435ca5a1e4fe2f5cbb5a1b0de9a0957d1c941e0f463795fdedcb072dc94 Jul 08 16:35:23.196068 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.196038 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5c5x4"] Jul 08 16:35:23.198496 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:23.198472 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc907588d_0c5d_452e_92b6_a89b25ea9fb5.slice/crio-894ac5d917b3985e114076c3e0c41585b5268c59f0abe6dfbb87e8819ed65f8a WatchSource:0}: Error finding container 894ac5d917b3985e114076c3e0c41585b5268c59f0abe6dfbb87e8819ed65f8a: Status 404 returned error can't find the container with id 894ac5d917b3985e114076c3e0c41585b5268c59f0abe6dfbb87e8819ed65f8a Jul 08 16:35:23.423486 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.423457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:23.423651 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.423565 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:23.423651 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.423630 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls podName:444b53cb-5891-4499-a486-b733e68e21b9 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:39.423603245 +0000 UTC m=+82.705313294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-m8xp4" (UID: "444b53cb-5891-4499-a486-b733e68e21b9") : secret "cluster-monitoring-operator-tls" not found Jul 08 16:35:23.582204 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.582124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5c5x4" event={"ID":"c907588d-0c5d-452e-92b6-a89b25ea9fb5","Type":"ContainerStarted","Data":"894ac5d917b3985e114076c3e0c41585b5268c59f0abe6dfbb87e8819ed65f8a"} Jul 08 16:35:23.583202 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.583176 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d59t8" event={"ID":"096d2ce7-f666-481f-a7a7-03bbab8947f2","Type":"ContainerStarted","Data":"6e1e4435ca5a1e4fe2f5cbb5a1b0de9a0957d1c941e0f463795fdedcb072dc94"} Jul 08 16:35:23.827615 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.827562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:35:23.827615 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:23.827617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") pod \"image-registry-5c59f7dd88-lj2rp\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:23.827881 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.827828 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 16:35:23.827881 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.827845 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c59f7dd88-lj2rp: secret "image-registry-tls" not found Jul 08 16:35:23.827984 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.827905 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls podName:7a824630-a68b-4566-9fab-cf445dabc095 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:39.827885988 +0000 UTC m=+83.109596054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls") pod "image-registry-5c59f7dd88-lj2rp" (UID: "7a824630-a68b-4566-9fab-cf445dabc095") : secret "image-registry-tls" not found Jul 08 16:35:23.828165 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.828135 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 16:35:23.828291 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:23.828193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls podName:a7a81626-2dd9-4629-b625-f9cb41340f67 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:55.828176979 +0000 UTC m=+99.109887031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls") pod "dns-default-tj766" (UID: "a7a81626-2dd9-4629-b625-f9cb41340f67") : secret "dns-default-metrics-tls" not found Jul 08 16:35:28.597532 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:28.597492 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5c5x4" event={"ID":"c907588d-0c5d-452e-92b6-a89b25ea9fb5","Type":"ContainerStarted","Data":"f06a0840752273a86fd2ca8c895fbf0df6cbe99b0efd062c2a6c6c608e2527bc"} Jul 08 16:35:28.598108 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:28.597634 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:35:28.598822 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:28.598802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d59t8" event={"ID":"096d2ce7-f666-481f-a7a7-03bbab8947f2","Type":"ContainerStarted","Data":"f1c1da1e7331856c9cb7711a17b1534b1f4ce734e1408fe0488a94a8fe144063"} Jul 08 16:35:28.615033 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:28.614991 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5c5x4" podStartSLOduration=66.981487841 podStartE2EDuration="1m11.61497758s" totalImagesPullingTime="4.633489739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:28.614139638 +0000 UTC m=+71.895849708" watchObservedRunningTime="2026-07-08 16:35:28.61497758 +0000 UTC m=+71.896687646" Jul 08 16:35:28.630108 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:28.630068 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d59t8" podStartSLOduration=66.978605697 podStartE2EDuration="1m11.630056825s" totalImagesPullingTime="4.651451128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:28.629335097 +0000 UTC m=+71.911045167" watchObservedRunningTime="2026-07-08 16:35:28.630056825 +0000 UTC m=+71.911766896" Jul 08 16:35:31.193488 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.193452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:31.193932 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.193541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:31.193932 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:31.193639 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 16:35:31.193932 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:31.193743 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls podName:2ff73140-abdc-441c-8b1b-537e13f6c68e nodeName:}" failed. No retries permitted until 2026-07-08 16:35:47.193719415 +0000 UTC m=+90.475429478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4zqn" (UID: "2ff73140-abdc-441c-8b1b-537e13f6c68e") : secret "insights-runtime-extractor-tls" not found Jul 08 16:35:31.194068 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.194031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ff73140-abdc-441c-8b1b-537e13f6c68e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:31.334778 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.334744 2577 scope.go:117] "RemoveContainer" containerID="2503547f1c62b53372e20ea7334d955c4f3cb0053b88318cd35ca090925b2b26" Jul 08 16:35:31.608169 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.608147 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:35:31.608338 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.608210 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" event={"ID":"5a2fd05f-50f1-4a1d-bd27-efe9892427c9","Type":"ContainerStarted","Data":"1aea1cf86babc10764de1a0c12019c530357004ae3291bbc693fa5739305d57e"} Jul 08 16:35:31.608510 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.608492 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:31.634806 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.634762 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" podStartSLOduration=22.26948305 podStartE2EDuration="24.634747194s" totalImagesPullingTime="2.365264144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:31.633198495 +0000 UTC m=+74.914908567" watchObservedRunningTime="2026-07-08 16:35:31.634747194 +0000 UTC m=+74.916457264" Jul 08 16:35:31.893012 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:31.892940 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-gs2hb" Jul 08 16:35:36.287104 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.287070 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6"] Jul 08 16:35:36.288983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.288963 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.290166 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.290140 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47"] Jul 08 16:35:36.291962 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.291944 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.296208 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296038 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 16:35:36.296341 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d497t\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296557 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296602 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296659 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296897 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 16:35:36.296983 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.296934 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 16:35:36.297344 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.297317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 16:35:36.305089 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.305070 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6"] Jul 08 16:35:36.315358 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.315336 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47"] Jul 08 16:35:36.317874 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.317856 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c59f7dd88-lj2rp"] Jul 08 16:35:36.318044 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:36.318029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" podUID="7a824630-a68b-4566-9fab-cf445dabc095" Jul 08 16:35:36.339520 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.339503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.339624 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.339566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.440819 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.440790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.440971 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.440829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nhft\" (UniqueName: \"kubernetes.io/projected/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-kube-api-access-7nhft\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.440971 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.440899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.440971 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.440935 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.441132 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.441020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.441132 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.441077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.441132 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.441118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.441262 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.441155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.441682 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.441663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.443112 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.443097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4d56f716-900e-4d90-b8af-1cb8b2e8e95d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-qwlm6\" (UID: \"4d56f716-900e-4d90-b8af-1cb8b2e8e95d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.542276 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.542276 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.542276 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.542510 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nhft\" (UniqueName: \"kubernetes.io/projected/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-kube-api-access-7nhft\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.542510 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.542510 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.542370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.543146 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.543121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.544628 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.544601 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-ca\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.544759 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.544742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.544824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.544761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.544824 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.544786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-hub\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.555315 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.555278 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nhft\" (UniqueName: \"kubernetes.io/projected/b0b4b9b2-e82f-473a-b1e1-11274e4baa9f-kube-api-access-7nhft\") pod \"cluster-proxy-proxy-agent-794c55d9c6-mzv47\" (UID: \"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.599814 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.599794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" Jul 08 16:35:36.615449 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.615427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" Jul 08 16:35:36.621496 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.621470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:36.627563 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.627540 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:36.738912 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.738881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6"] Jul 08 16:35:36.741714 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:36.741666 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d56f716_900e_4d90_b8af_1cb8b2e8e95d.slice/crio-2fbe0165951896fc2b9a4137c82d39ab5034b52a6ea3e1f5dc79e562383edd15 WatchSource:0}: Error finding container 2fbe0165951896fc2b9a4137c82d39ab5034b52a6ea3e1f5dc79e562383edd15: Status 404 returned error can't find the container with id 2fbe0165951896fc2b9a4137c82d39ab5034b52a6ea3e1f5dc79e562383edd15 Jul 08 16:35:36.743928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.743908 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5dvl\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744041 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.743940 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744041 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.743960 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744041 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744011 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744252 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744049 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744252 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744089 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744252 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744119 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets\") pod \"7a824630-a68b-4566-9fab-cf445dabc095\" (UID: \"7a824630-a68b-4566-9fab-cf445dabc095\") " Jul 08 16:35:36.744409 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744273 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:35:36.744409 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744387 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a824630-a68b-4566-9fab-cf445dabc095-ca-trust-extracted\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.744512 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744458 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:35:36.744852 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.744821 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:35:36.746319 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.746294 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:35:36.746401 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.746375 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:35:36.746444 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.746420 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl" (OuterVolumeSpecName: "kube-api-access-f5dvl") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "kube-api-access-f5dvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:35:36.746444 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.746428 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7a824630-a68b-4566-9fab-cf445dabc095" (UID: "7a824630-a68b-4566-9fab-cf445dabc095"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:35:36.751869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.751850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47"] Jul 08 16:35:36.754424 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:36.754403 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0b4b9b2_e82f_473a_b1e1_11274e4baa9f.slice/crio-c025579afa4f2cbb80c47687941e41c25c2b1879bd4d14c36532248662ee6cba WatchSource:0}: Error finding container c025579afa4f2cbb80c47687941e41c25c2b1879bd4d14c36532248662ee6cba: Status 404 returned error can't find the container with id c025579afa4f2cbb80c47687941e41c25c2b1879bd4d14c36532248662ee6cba Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844848 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-registry-certificates\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844871 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-installation-pull-secrets\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844883 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5dvl\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-kube-api-access-f5dvl\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844891 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-bound-sa-token\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844900 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a824630-a68b-4566-9fab-cf445dabc095-trusted-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:36.844913 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:36.844908 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a824630-a68b-4566-9fab-cf445dabc095-image-registry-private-configuration\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:37.628158 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.628079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" event={"ID":"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f","Type":"ContainerStarted","Data":"c025579afa4f2cbb80c47687941e41c25c2b1879bd4d14c36532248662ee6cba"} Jul 08 16:35:37.631845 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.631818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c59f7dd88-lj2rp" Jul 08 16:35:37.632047 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.632007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" event={"ID":"4d56f716-900e-4d90-b8af-1cb8b2e8e95d","Type":"ContainerStarted","Data":"2fbe0165951896fc2b9a4137c82d39ab5034b52a6ea3e1f5dc79e562383edd15"} Jul 08 16:35:37.667448 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.667415 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c59f7dd88-lj2rp"] Jul 08 16:35:37.670613 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.670583 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c59f7dd88-lj2rp"] Jul 08 16:35:37.752996 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:37.752963 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a824630-a68b-4566-9fab-cf445dabc095-registry-tls\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:35:39.339355 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.339320 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a824630-a68b-4566-9fab-cf445dabc095" path="/var/lib/kubelet/pods/7a824630-a68b-4566-9fab-cf445dabc095/volumes" Jul 08 16:35:39.468682 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.468645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:39.471309 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.471284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/444b53cb-5891-4499-a486-b733e68e21b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-m8xp4\" (UID: \"444b53cb-5891-4499-a486-b733e68e21b9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:39.640392 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.640355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" event={"ID":"4d56f716-900e-4d90-b8af-1cb8b2e8e95d","Type":"ContainerStarted","Data":"d19a3e4a06a7a1d62547efe87e17d2cf63cd7d466c214ae458dace9244a4a40b"} Jul 08 16:35:39.652830 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.652803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nbq7b\"" Jul 08 16:35:39.656221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.656169 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-qwlm6" podStartSLOduration=1.676899561 podStartE2EDuration="3.65614927s" totalImagesPullingTime="1.979249709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:39.6552092 +0000 UTC m=+82.936919280" watchObservedRunningTime="2026-07-08 16:35:39.65614927 +0000 UTC m=+82.937859342" Jul 08 16:35:39.661653 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:39.661632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" Jul 08 16:35:40.099698 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.099414 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4"] Jul 08 16:35:40.103808 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:40.103777 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444b53cb_5891_4499_a486_b733e68e21b9.slice/crio-7bf8472ddb1ba4d53b1350f2512fd5580a703027a22aad502ef48b3d6576c9c4 WatchSource:0}: Error finding container 7bf8472ddb1ba4d53b1350f2512fd5580a703027a22aad502ef48b3d6576c9c4: Status 404 returned error can't find the container with id 7bf8472ddb1ba4d53b1350f2512fd5580a703027a22aad502ef48b3d6576c9c4 Jul 08 16:35:40.645580 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.645539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" event={"ID":"444b53cb-5891-4499-a486-b733e68e21b9","Type":"ContainerStarted","Data":"7bf8472ddb1ba4d53b1350f2512fd5580a703027a22aad502ef48b3d6576c9c4"} Jul 08 16:35:40.647829 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.647801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" event={"ID":"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f","Type":"ContainerStarted","Data":"ad77c39847ef12c82eebd1b349b4dc5f9b1e0c0ab97d4f33cf0202ab222dbf7d"} Jul 08 16:35:40.647987 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.647839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" event={"ID":"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f","Type":"ContainerStarted","Data":"9ddbf7e4785cac09cd4e5fb889a42a569b7a20338c5c7d270ce24431ad8b0f4b"} Jul 08 16:35:40.647987 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.647855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" event={"ID":"b0b4b9b2-e82f-473a-b1e1-11274e4baa9f","Type":"ContainerStarted","Data":"881d8189d6f57c275c0d21d13bd8a55c59970d70d5c3437bbbeac156fc5155e4"} Jul 08 16:35:40.674849 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:40.674796 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-794c55d9c6-mzv47" podStartSLOduration=1.4090223370000001 podStartE2EDuration="4.674776569s" totalImagesPullingTime="3.265754232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:40.674500645 +0000 UTC m=+83.956210718" watchObservedRunningTime="2026-07-08 16:35:40.674776569 +0000 UTC m=+83.956486643" Jul 08 16:35:41.652260 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:41.652201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" event={"ID":"444b53cb-5891-4499-a486-b733e68e21b9","Type":"ContainerStarted","Data":"6182b30ce2d2a48dcd0aac49944afa89bd46eeab7f117c939f0416125396e539"} Jul 08 16:35:41.676732 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:41.676542 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-m8xp4" podStartSLOduration=33.236970622 podStartE2EDuration="34.676521416s" totalImagesPullingTime="1.439550794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:41.675216325 +0000 UTC m=+84.956926400" watchObservedRunningTime="2026-07-08 16:35:41.676521416 +0000 UTC m=+84.958231489" Jul 08 16:35:42.091973 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.091940 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6"] Jul 08 16:35:42.093884 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.093868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:42.096535 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.096513 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 16:35:42.096623 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.096554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hv7xh\"" Jul 08 16:35:42.106187 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.106156 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6"] Jul 08 16:35:42.195050 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.195015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-mmjz6\" (UID: \"7eb6cbfb-1897-45d0-ae39-eb1b222aef02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:42.296076 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.296036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-mmjz6\" (UID: \"7eb6cbfb-1897-45d0-ae39-eb1b222aef02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:42.296243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:42.296156 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 08 16:35:42.296243 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:35:42.296217 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates podName:7eb6cbfb-1897-45d0-ae39-eb1b222aef02 nodeName:}" failed. No retries permitted until 2026-07-08 16:35:42.796203174 +0000 UTC m=+86.077913223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-mmjz6" (UID: "7eb6cbfb-1897-45d0-ae39-eb1b222aef02") : secret "prometheus-operator-admission-webhook-tls" not found Jul 08 16:35:42.801101 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.801069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-mmjz6\" (UID: \"7eb6cbfb-1897-45d0-ae39-eb1b222aef02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:42.803425 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:42.803406 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb6cbfb-1897-45d0-ae39-eb1b222aef02-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-mmjz6\" (UID: \"7eb6cbfb-1897-45d0-ae39-eb1b222aef02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:43.002297 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:43.002239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:43.133193 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:43.133155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6"] Jul 08 16:35:43.137543 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:43.137519 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb6cbfb_1897_45d0_ae39_eb1b222aef02.slice/crio-87c254d50211202d2548d9fbdf57430ae5ed8ae7b79bf2c640e6c113258c00a9 WatchSource:0}: Error finding container 87c254d50211202d2548d9fbdf57430ae5ed8ae7b79bf2c640e6c113258c00a9: Status 404 returned error can't find the container with id 87c254d50211202d2548d9fbdf57430ae5ed8ae7b79bf2c640e6c113258c00a9 Jul 08 16:35:43.660694 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:43.660660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" event={"ID":"7eb6cbfb-1897-45d0-ae39-eb1b222aef02","Type":"ContainerStarted","Data":"87c254d50211202d2548d9fbdf57430ae5ed8ae7b79bf2c640e6c113258c00a9"} Jul 08 16:35:44.665399 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:44.665368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" event={"ID":"7eb6cbfb-1897-45d0-ae39-eb1b222aef02","Type":"ContainerStarted","Data":"d4cf9ea5cc590ca7c4f7c104c169b45cdf1cacba2c81f7f644b4ebfbe7c917fd"} Jul 08 16:35:44.666090 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:44.666060 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:44.671932 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:44.671912 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" Jul 08 16:35:44.685565 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:44.685516 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-mmjz6" podStartSLOduration=1.8215791239999999 podStartE2EDuration="2.68549872s" totalImagesPullingTime="863.919596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:44.684723742 +0000 UTC m=+87.966433816" watchObservedRunningTime="2026-07-08 16:35:44.68549872 +0000 UTC m=+87.967208793" Jul 08 16:35:46.807524 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.807490 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:35:46.809659 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.809637 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.811518 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.811499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812170 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812254 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812253 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812271 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g58qt\"" Jul 08 16:35:46.812348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.812196 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 16:35:46.820764 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.820740 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:35:46.933315 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.933475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gpxp\" (UniqueName: \"kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.933475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.933475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.933475 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933413 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:46.933606 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:46.933484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034511 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034511 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gpxp\" (UniqueName: \"kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034780 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034780 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034780 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034580 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.034780 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.034610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.035259 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.035236 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.035334 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.035315 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.035384 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.035362 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.037008 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.036991 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.037090 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.037071 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.045990 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.045965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gpxp\" (UniqueName: \"kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp\") pod \"console-7759c6b847-wft77\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.119142 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.119116 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:47.236489 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.236450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:47.239283 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.239260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ff73140-abdc-441c-8b1b-537e13f6c68e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4zqn\" (UID: \"2ff73140-abdc-441c-8b1b-537e13f6c68e\") " pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:47.272604 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.272575 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:35:47.275383 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:47.275354 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eea2c8d_2e02_4bad_af72_29dc2105d723.slice/crio-55ed21b8ddf1de5034f772e4c4b8475c9f62504c45f3318c759b6f7fd6687856 WatchSource:0}: Error finding container 55ed21b8ddf1de5034f772e4c4b8475c9f62504c45f3318c759b6f7fd6687856: Status 404 returned error can't find the container with id 55ed21b8ddf1de5034f772e4c4b8475c9f62504c45f3318c759b6f7fd6687856 Jul 08 16:35:47.496134 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.496053 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-82p44\"" Jul 08 16:35:47.504019 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.504001 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4zqn" Jul 08 16:35:47.626163 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.626137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4zqn"] Jul 08 16:35:47.629105 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:47.629083 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff73140_abdc_441c_8b1b_537e13f6c68e.slice/crio-d61577429e86b864e0dad9c108fddc1aeb6bab3abb9bb69dd87fca51b0730f65 WatchSource:0}: Error finding container d61577429e86b864e0dad9c108fddc1aeb6bab3abb9bb69dd87fca51b0730f65: Status 404 returned error can't find the container with id d61577429e86b864e0dad9c108fddc1aeb6bab3abb9bb69dd87fca51b0730f65 Jul 08 16:35:47.676633 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.676601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4zqn" event={"ID":"2ff73140-abdc-441c-8b1b-537e13f6c68e","Type":"ContainerStarted","Data":"d61577429e86b864e0dad9c108fddc1aeb6bab3abb9bb69dd87fca51b0730f65"} Jul 08 16:35:47.677664 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:47.677629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759c6b847-wft77" event={"ID":"1eea2c8d-2e02-4bad-af72-29dc2105d723","Type":"ContainerStarted","Data":"55ed21b8ddf1de5034f772e4c4b8475c9f62504c45f3318c759b6f7fd6687856"} Jul 08 16:35:52.700589 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:52.700539 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4zqn" event={"ID":"2ff73140-abdc-441c-8b1b-537e13f6c68e","Type":"ContainerStarted","Data":"9754355e41021b378b93cab42a9399f670910ced945fb6123338b1f638b45f78"} Jul 08 16:35:52.702302 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:52.702275 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759c6b847-wft77" event={"ID":"1eea2c8d-2e02-4bad-af72-29dc2105d723","Type":"ContainerStarted","Data":"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25"} Jul 08 16:35:52.725288 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:52.725241 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7759c6b847-wft77" podStartSLOduration=1.435696308 podStartE2EDuration="6.725228058s" totalImagesPullingTime="5.28953175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:52.724485449 +0000 UTC m=+96.006195520" watchObservedRunningTime="2026-07-08 16:35:52.725228058 +0000 UTC m=+96.006938129" Jul 08 16:35:53.707471 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:53.707432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4zqn" event={"ID":"2ff73140-abdc-441c-8b1b-537e13f6c68e","Type":"ContainerStarted","Data":"86225297aa1292ac6ef39d9f0e371de7b605ebc8f38703358cc96c9f51cae0b7"} Jul 08 16:35:55.914667 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:55.914637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:35:55.917031 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:55.917010 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7a81626-2dd9-4629-b625-f9cb41340f67-metrics-tls\") pod \"dns-default-tj766\" (UID: \"a7a81626-2dd9-4629-b625-f9cb41340f67\") " pod="openshift-dns/dns-default-tj766" Jul 08 16:35:56.198479 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.198449 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rv4r\"" Jul 08 16:35:56.206940 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.206918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tj766" Jul 08 16:35:56.335502 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.335474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tj766"] Jul 08 16:35:56.340288 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:35:56.340262 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a81626_2dd9_4629_b625_f9cb41340f67.slice/crio-1c37322c7aa3a41e8889047106ac769a19b015d761a0b85b04bf27f8007da862 WatchSource:0}: Error finding container 1c37322c7aa3a41e8889047106ac769a19b015d761a0b85b04bf27f8007da862: Status 404 returned error can't find the container with id 1c37322c7aa3a41e8889047106ac769a19b015d761a0b85b04bf27f8007da862 Jul 08 16:35:56.718609 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.718568 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4zqn" event={"ID":"2ff73140-abdc-441c-8b1b-537e13f6c68e","Type":"ContainerStarted","Data":"36ecc73db6e1beaf2a7607932b6eafb4289d01e67cc9e73a5dae0e3d6225a100"} Jul 08 16:35:56.719673 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.719644 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj766" event={"ID":"a7a81626-2dd9-4629-b625-f9cb41340f67","Type":"ContainerStarted","Data":"1c37322c7aa3a41e8889047106ac769a19b015d761a0b85b04bf27f8007da862"} Jul 08 16:35:56.735986 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:56.735944 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s4zqn" podStartSLOduration=33.737716111 podStartE2EDuration="41.735929973s" totalImagesPullingTime="7.998213862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:35:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:56.734933481 +0000 UTC m=+100.016643552" watchObservedRunningTime="2026-07-08 16:35:56.735929973 +0000 UTC m=+100.017640044" Jul 08 16:35:57.119697 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:57.119649 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:57.120226 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:57.119749 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:57.125133 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:57.125107 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:57.728241 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:57.728211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:35:58.728714 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:58.728678 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj766" event={"ID":"a7a81626-2dd9-4629-b625-f9cb41340f67","Type":"ContainerStarted","Data":"989223e8e85ddede2502580910c9fba36b4efd40c8a800fff38ed9fa44f4ee20"} Jul 08 16:35:58.729070 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:58.728770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tj766" event={"ID":"a7a81626-2dd9-4629-b625-f9cb41340f67","Type":"ContainerStarted","Data":"48ec0e7c98fc6916842df79b4ab1d3a0382cf113f8f186e0a63134d817c5c704"} Jul 08 16:35:58.748259 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:58.748208 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tj766" podStartSLOduration=66.208270252 podStartE2EDuration="1m7.748191043s" totalImagesPullingTime="1.539920791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:35:58.747573596 +0000 UTC m=+102.029283668" watchObservedRunningTime="2026-07-08 16:35:58.748191043 +0000 UTC m=+102.029901115" Jul 08 16:35:59.264416 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:59.264385 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:35:59.603906 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:59.603877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5c5x4" Jul 08 16:35:59.731908 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:35:59.731853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tj766" Jul 08 16:36:02.570088 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.570052 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9"] Jul 08 16:36:02.573106 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.573084 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.574729 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.574695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x5cfq"] Jul 08 16:36:02.575694 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.575679 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 16:36:02.576223 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.576204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rxfm8\"" Jul 08 16:36:02.576319 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.576223 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 16:36:02.576319 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.576231 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 16:36:02.576319 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.576223 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 16:36:02.576482 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.576469 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.578988 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.578963 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bnbv8\"" Jul 08 16:36:02.579503 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.579379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 16:36:02.579782 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.579762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 16:36:02.579941 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.579811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 16:36:02.588219 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.588194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9"] Jul 08 16:36:02.663045 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-wtmp\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663045 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663051 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-root\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-tls\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663102 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-textfile\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-metrics-client-ca\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfb701a4-5e50-48b5-8143-6e17baf27154-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.663248 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dgl\" (UniqueName: \"kubernetes.io/projected/f77774b0-85f5-494d-8cf0-b3ede32d61ee-kube-api-access-67dgl\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-sys\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.663525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.663447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcz7q\" (UniqueName: \"kubernetes.io/projected/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-api-access-jcz7q\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.764451 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764418 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67dgl\" (UniqueName: \"kubernetes.io/projected/f77774b0-85f5-494d-8cf0-b3ede32d61ee-kube-api-access-67dgl\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764637 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.764637 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.764637 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-sys\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcz7q\" (UniqueName: \"kubernetes.io/projected/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-api-access-jcz7q\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:36:02.764683 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764732 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-wtmp\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764772 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-sys\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:36:02.764787 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls podName:cfb701a4-5e50-48b5-8143-6e17baf27154 nodeName:}" failed. No retries permitted until 2026-07-08 16:36:03.264764292 +0000 UTC m=+106.546474343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-v5gh9" (UID: "cfb701a4-5e50-48b5-8143-6e17baf27154") : secret "kube-state-metrics-tls" not found Jul 08 16:36:02.764848 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-root\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-tls\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-textfile\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-root\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-wtmp\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-metrics-client-ca\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfb701a4-5e50-48b5-8143-6e17baf27154-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.764996 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.765212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.765611 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-textfile\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765611 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfb701a4-5e50-48b5-8143-6e17baf27154-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.765611 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765388 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765611 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765507 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f77774b0-85f5-494d-8cf0-b3ede32d61ee-metrics-client-ca\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.765820 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.765785 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.766134 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.766113 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb701a4-5e50-48b5-8143-6e17baf27154-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.767050 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.767026 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.767165 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.767128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f77774b0-85f5-494d-8cf0-b3ede32d61ee-node-exporter-tls\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.767438 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.767420 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.779552 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.779526 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dgl\" (UniqueName: \"kubernetes.io/projected/f77774b0-85f5-494d-8cf0-b3ede32d61ee-kube-api-access-67dgl\") pod \"node-exporter-x5cfq\" (UID: \"f77774b0-85f5-494d-8cf0-b3ede32d61ee\") " pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.779740 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.779720 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcz7q\" (UniqueName: \"kubernetes.io/projected/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-api-access-jcz7q\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:02.893834 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:02.893800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x5cfq" Jul 08 16:36:02.905242 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:02.905212 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77774b0_85f5_494d_8cf0_b3ede32d61ee.slice/crio-75f23339c939c60f10bf4c5c8e34918b93ff2a1844f6d82cfeff6548471fa99f WatchSource:0}: Error finding container 75f23339c939c60f10bf4c5c8e34918b93ff2a1844f6d82cfeff6548471fa99f: Status 404 returned error can't find the container with id 75f23339c939c60f10bf4c5c8e34918b93ff2a1844f6d82cfeff6548471fa99f Jul 08 16:36:03.270052 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:03.269968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:03.272342 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:03.272311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb701a4-5e50-48b5-8143-6e17baf27154-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-v5gh9\" (UID: \"cfb701a4-5e50-48b5-8143-6e17baf27154\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:03.487223 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:03.487191 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" Jul 08 16:36:03.634324 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:03.634241 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9"] Jul 08 16:36:03.748928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:03.748896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5cfq" event={"ID":"f77774b0-85f5-494d-8cf0-b3ede32d61ee","Type":"ContainerStarted","Data":"75f23339c939c60f10bf4c5c8e34918b93ff2a1844f6d82cfeff6548471fa99f"} Jul 08 16:36:03.824247 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:03.824168 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb701a4_5e50_48b5_8143_6e17baf27154.slice/crio-c3f9704e2e65badb36b6d541d6144e95be2a62fd7aff805c1639085204915d8c WatchSource:0}: Error finding container c3f9704e2e65badb36b6d541d6144e95be2a62fd7aff805c1639085204915d8c: Status 404 returned error can't find the container with id c3f9704e2e65badb36b6d541d6144e95be2a62fd7aff805c1639085204915d8c Jul 08 16:36:04.754941 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:04.754902 2577 generic.go:356] "Generic (PLEG): container finished" podID="f77774b0-85f5-494d-8cf0-b3ede32d61ee" containerID="cca67069754f2f2c70d2ffd3a910b0432ba0ac8b9946cd48fa410c52f16bd5a9" exitCode=0 Jul 08 16:36:04.755417 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:04.754991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5cfq" event={"ID":"f77774b0-85f5-494d-8cf0-b3ede32d61ee","Type":"ContainerDied","Data":"cca67069754f2f2c70d2ffd3a910b0432ba0ac8b9946cd48fa410c52f16bd5a9"} Jul 08 16:36:04.756266 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:04.756235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" event={"ID":"cfb701a4-5e50-48b5-8143-6e17baf27154","Type":"ContainerStarted","Data":"c3f9704e2e65badb36b6d541d6144e95be2a62fd7aff805c1639085204915d8c"} Jul 08 16:36:05.765587 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.765551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5cfq" event={"ID":"f77774b0-85f5-494d-8cf0-b3ede32d61ee","Type":"ContainerStarted","Data":"a7659b95c4cc7ee9237799aad09003b9ea845a55c4e18fdd231db410cd187c54"} Jul 08 16:36:05.766064 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.765625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x5cfq" event={"ID":"f77774b0-85f5-494d-8cf0-b3ede32d61ee","Type":"ContainerStarted","Data":"627497d82c00932d87268776aebc0b42b13e1d51b7b46e8810ab428e37637d89"} Jul 08 16:36:05.767466 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.767440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" event={"ID":"cfb701a4-5e50-48b5-8143-6e17baf27154","Type":"ContainerStarted","Data":"3f57233ad6501b32909efd13e1a5a7b2fc741304c43eff3935ebfce129765505"} Jul 08 16:36:05.767600 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.767491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" event={"ID":"cfb701a4-5e50-48b5-8143-6e17baf27154","Type":"ContainerStarted","Data":"fe0475ad81ba0129a544dba322b5987c5fa20c8f652afeaa3f8548bb50e20da2"} Jul 08 16:36:05.767600 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.767527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" event={"ID":"cfb701a4-5e50-48b5-8143-6e17baf27154","Type":"ContainerStarted","Data":"c1bbf900d90d87692ac602a5691ee1d5ae77476b011cccd0b076bd71cc236216"} Jul 08 16:36:05.789115 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.789072 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x5cfq" podStartSLOduration=2.783464364 podStartE2EDuration="3.78905927s" totalImagesPullingTime="941.440522ms" totalInitContainerRuntime="64.154384ms" isStatefulPod=true podCreationTimestamp="2026-07-08 16:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:05.787979746 +0000 UTC m=+109.069689817" watchObservedRunningTime="2026-07-08 16:36:05.78905927 +0000 UTC m=+109.070769341" Jul 08 16:36:05.820613 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:05.820560 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-v5gh9" podStartSLOduration=2.5580258860000002 podStartE2EDuration="3.820545535s" totalImagesPullingTime="1.262519649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:05.819066881 +0000 UTC m=+109.100776963" watchObservedRunningTime="2026-07-08 16:36:05.820545535 +0000 UTC m=+109.102255642" Jul 08 16:36:06.977125 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.977089 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-875cf55d6-x6k5j"] Jul 08 16:36:06.980457 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.980437 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:06.982645 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.982626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tn6bb\"" Jul 08 16:36:06.982770 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.982724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 16:36:06.983221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.983200 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 16:36:06.983312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.983250 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 16:36:06.983376 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.983345 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 16:36:06.983376 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.983372 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5lfvo267jatuk\"" Jul 08 16:36:06.991398 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:06.991377 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-875cf55d6-x6k5j"] Jul 08 16:36:07.000516 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-tls\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000620 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000620 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4t2\" (UniqueName: \"kubernetes.io/projected/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-kube-api-access-5j4t2\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000620 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-audit-log\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000629 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-metrics-server-audit-profiles\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-client-certs\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.000808 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.000733 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-client-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.101634 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101595 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-metrics-server-audit-profiles\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.101869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-client-certs\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.101869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-client-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.101869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-tls\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.101869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.102100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4t2\" (UniqueName: \"kubernetes.io/projected/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-kube-api-access-5j4t2\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.102100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.101909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-audit-log\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.102319 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.102293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-audit-log\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.102558 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.102539 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.102828 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.102807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-metrics-server-audit-profiles\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.104397 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.104370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-tls\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.104612 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.104598 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-client-ca-bundle\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.104695 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.104643 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-secret-metrics-server-client-certs\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.111614 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.111587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4t2\" (UniqueName: \"kubernetes.io/projected/f5a99df4-8e05-49bf-8aa5-10eb3195e4f5-kube-api-access-5j4t2\") pod \"metrics-server-875cf55d6-x6k5j\" (UID: \"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5\") " pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.289174 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.289085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:07.368208 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.368157 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:07.371515 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.371476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.383355 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.383331 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 16:36:07.395412 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.395384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:07.403853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.403825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtwm6\" (UniqueName: \"kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404009 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.403887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404009 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.403922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404009 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.403950 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404222 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.404019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404222 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.404130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.404222 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.404154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.433224 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.433194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-875cf55d6-x6k5j"] Jul 08 16:36:07.436031 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:07.436006 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a99df4_8e05_49bf_8aa5_10eb3195e4f5.slice/crio-6ca34c92cdcae6dc4378bf855a2cbd82594b3e1e86c01b4675470bae1bcb6c23 WatchSource:0}: Error finding container 6ca34c92cdcae6dc4378bf855a2cbd82594b3e1e86c01b4675470bae1bcb6c23: Status 404 returned error can't find the container with id 6ca34c92cdcae6dc4378bf855a2cbd82594b3e1e86c01b4675470bae1bcb6c23 Jul 08 16:36:07.504911 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.504877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.504911 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.504915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.505146 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.504954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.505146 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.504999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.505260 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.505235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.505330 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.505315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtwm6\" (UniqueName: \"kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.505388 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.505378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.506015 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.505901 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.506015 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.505906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.506195 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.506049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.506195 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.506173 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.507397 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.507373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.507648 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.507626 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.515291 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.515270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtwm6\" (UniqueName: \"kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6\") pod \"console-789dc9dccd-lxb67\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.683861 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.683829 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:07.776447 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.776414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" event={"ID":"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5","Type":"ContainerStarted","Data":"6ca34c92cdcae6dc4378bf855a2cbd82594b3e1e86c01b4675470bae1bcb6c23"} Jul 08 16:36:07.823784 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:07.823751 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:07.827248 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:07.827219 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9277b5_d267_40bf_8fc2_302c871ea810.slice/crio-c71f2d368a7bbcd9212d48c7c2164f0697721cd8f262e8621325f2710a14944d WatchSource:0}: Error finding container c71f2d368a7bbcd9212d48c7c2164f0697721cd8f262e8621325f2710a14944d: Status 404 returned error can't find the container with id c71f2d368a7bbcd9212d48c7c2164f0697721cd8f262e8621325f2710a14944d Jul 08 16:36:08.781543 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:08.781510 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" event={"ID":"f5a99df4-8e05-49bf-8aa5-10eb3195e4f5","Type":"ContainerStarted","Data":"9427266fd403c84ebe8f48e72ef264e2df9af9134a9bf7eafcb0f1dfda1e595c"} Jul 08 16:36:08.783101 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:08.783069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dc9dccd-lxb67" event={"ID":"1b9277b5-d267-40bf-8fc2-302c871ea810","Type":"ContainerStarted","Data":"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0"} Jul 08 16:36:08.783224 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:08.783115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dc9dccd-lxb67" event={"ID":"1b9277b5-d267-40bf-8fc2-302c871ea810","Type":"ContainerStarted","Data":"c71f2d368a7bbcd9212d48c7c2164f0697721cd8f262e8621325f2710a14944d"} Jul 08 16:36:08.802928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:08.801302 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" podStartSLOduration=1.5892110229999998 podStartE2EDuration="2.801281895s" totalImagesPullingTime="1.212070872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:08.798923476 +0000 UTC m=+112.080633548" watchObservedRunningTime="2026-07-08 16:36:08.801281895 +0000 UTC m=+112.082991969" Jul 08 16:36:08.820593 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:08.820549 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-789dc9dccd-lxb67" podStartSLOduration=1.820533725 podStartE2EDuration="1.820533725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:08.820022331 +0000 UTC m=+112.101732404" watchObservedRunningTime="2026-07-08 16:36:08.820533725 +0000 UTC m=+112.102243796" Jul 08 16:36:09.737563 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:09.737534 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tj766" Jul 08 16:36:13.166807 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.166770 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:13.195091 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.195060 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:36:13.258172 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.258137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:36:13.258340 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.258262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356243 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356215 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356243 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356248 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh6w6\" (UniqueName: \"kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.356564 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.356463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.457828 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.457749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.457828 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.457795 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458058 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458149 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458188 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458237 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458287 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh6w6\" (UniqueName: \"kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458621 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458584 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458805 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.458899 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.458881 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.459033 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.459012 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.460359 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.460332 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.460537 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.460518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.468697 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.468673 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh6w6\" (UniqueName: \"kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6\") pod \"console-67b84bcbfb-bd6gr\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.567868 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.567833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:13.716831 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.716758 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:36:13.720264 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:13.720237 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1692216d_522e_45c7_8651_37fe14483d15.slice/crio-8255ec24540654b263fc8ccd61521352cba67135a34c9a020974c7571de9164a WatchSource:0}: Error finding container 8255ec24540654b263fc8ccd61521352cba67135a34c9a020974c7571de9164a: Status 404 returned error can't find the container with id 8255ec24540654b263fc8ccd61521352cba67135a34c9a020974c7571de9164a Jul 08 16:36:13.802526 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:13.802497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84bcbfb-bd6gr" event={"ID":"1692216d-522e-45c7-8651-37fe14483d15","Type":"ContainerStarted","Data":"8255ec24540654b263fc8ccd61521352cba67135a34c9a020974c7571de9164a"} Jul 08 16:36:14.808654 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:14.808615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84bcbfb-bd6gr" event={"ID":"1692216d-522e-45c7-8651-37fe14483d15","Type":"ContainerStarted","Data":"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee"} Jul 08 16:36:14.827030 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:14.826977 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67b84bcbfb-bd6gr" podStartSLOduration=1.826919569 podStartE2EDuration="1.826919569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:36:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:14.826022832 +0000 UTC m=+118.107732899" watchObservedRunningTime="2026-07-08 16:36:14.826919569 +0000 UTC m=+118.108629642" Jul 08 16:36:17.684811 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:17.684776 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:23.568869 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:23.568829 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:23.569385 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:23.568916 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:23.573790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:23.573771 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:23.843205 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:23.843130 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:36:24.751626 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:24.751575 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7759c6b847-wft77" podUID="1eea2c8d-2e02-4bad-af72-29dc2105d723" containerName="console" containerID="cri-o://a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25" gracePeriod=15 Jul 08 16:36:25.548606 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.548577 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:36:25.660839 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.660745 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.660839 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.660785 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.660839 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.660814 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gpxp\" (UniqueName: \"kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.660839 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.660832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.661171 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.660969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.661171 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.661029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca\") pod \"1eea2c8d-2e02-4bad-af72-29dc2105d723\" (UID: \"1eea2c8d-2e02-4bad-af72-29dc2105d723\") " Jul 08 16:36:25.661314 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.661286 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config" (OuterVolumeSpecName: "console-config") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:25.661314 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.661203 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:25.661425 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.661345 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca" (OuterVolumeSpecName: "service-ca") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:25.663099 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.663068 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp" (OuterVolumeSpecName: "kube-api-access-8gpxp") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "kube-api-access-8gpxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:25.663206 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.663101 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:25.663206 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.663155 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1eea2c8d-2e02-4bad-af72-29dc2105d723" (UID: "1eea2c8d-2e02-4bad-af72-29dc2105d723"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:25.762421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762387 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.762421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762415 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-oauth-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.762421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762425 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gpxp\" (UniqueName: \"kubernetes.io/projected/1eea2c8d-2e02-4bad-af72-29dc2105d723-kube-api-access-8gpxp\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.762421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762434 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-oauth-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.762924 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762443 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eea2c8d-2e02-4bad-af72-29dc2105d723-console-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.762924 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.762453 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eea2c8d-2e02-4bad-af72-29dc2105d723-service-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:25.847501 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.847471 2577 generic.go:356] "Generic (PLEG): container finished" podID="1eea2c8d-2e02-4bad-af72-29dc2105d723" containerID="a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25" exitCode=0 Jul 08 16:36:25.847673 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.847512 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759c6b847-wft77" Jul 08 16:36:25.847673 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.847557 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759c6b847-wft77" event={"ID":"1eea2c8d-2e02-4bad-af72-29dc2105d723","Type":"ContainerDied","Data":"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25"} Jul 08 16:36:25.847673 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.847609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759c6b847-wft77" event={"ID":"1eea2c8d-2e02-4bad-af72-29dc2105d723","Type":"ContainerDied","Data":"55ed21b8ddf1de5034f772e4c4b8475c9f62504c45f3318c759b6f7fd6687856"} Jul 08 16:36:25.847673 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.847631 2577 scope.go:117] "RemoveContainer" containerID="a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25" Jul 08 16:36:25.856543 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.856529 2577 scope.go:117] "RemoveContainer" containerID="a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25" Jul 08 16:36:25.856850 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:36:25.856828 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25\": container with ID starting with a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25 not found: ID does not exist" containerID="a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25" Jul 08 16:36:25.856945 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.856854 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25"} err="failed to get container status \"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25\": rpc error: code = NotFound desc = could not find container \"a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25\": container with ID starting with a90d1d18f661dfd3bac9e4809e84143c29850b9a3321efe9bae6e6a41eb88d25 not found: ID does not exist" Jul 08 16:36:25.868881 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.868860 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:36:25.875660 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:25.875640 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7759c6b847-wft77"] Jul 08 16:36:26.974345 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:26.974312 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:36:26.976531 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:26.976506 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4bff7c4-503c-465b-a028-1f48a7318748-metrics-certs\") pod \"network-metrics-daemon-n8gml\" (UID: \"b4bff7c4-503c-465b-a028-1f48a7318748\") " pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:36:27.149373 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.149343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dwzcp\"" Jul 08 16:36:27.157936 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.157914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8gml" Jul 08 16:36:27.289880 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.289853 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:27.290042 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.289924 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:27.308304 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.308270 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n8gml"] Jul 08 16:36:27.311053 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:36:27.311025 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4bff7c4_503c_465b_a028_1f48a7318748.slice/crio-bced682f96f3fecf077c6846f7a2efe8adb61856864aa7bb1465b198c3f7cee0 WatchSource:0}: Error finding container bced682f96f3fecf077c6846f7a2efe8adb61856864aa7bb1465b198c3f7cee0: Status 404 returned error can't find the container with id bced682f96f3fecf077c6846f7a2efe8adb61856864aa7bb1465b198c3f7cee0 Jul 08 16:36:27.342879 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.342849 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eea2c8d-2e02-4bad-af72-29dc2105d723" path="/var/lib/kubelet/pods/1eea2c8d-2e02-4bad-af72-29dc2105d723/volumes" Jul 08 16:36:27.856560 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:27.856526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8gml" event={"ID":"b4bff7c4-503c-465b-a028-1f48a7318748","Type":"ContainerStarted","Data":"bced682f96f3fecf077c6846f7a2efe8adb61856864aa7bb1465b198c3f7cee0"} Jul 08 16:36:28.862295 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:28.862261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8gml" event={"ID":"b4bff7c4-503c-465b-a028-1f48a7318748","Type":"ContainerStarted","Data":"f8ba6a566cb0d07f4b5c52c4dc18983a4749bd4535d936c18e08cb584f338ade"} Jul 08 16:36:28.862749 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:28.862311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8gml" event={"ID":"b4bff7c4-503c-465b-a028-1f48a7318748","Type":"ContainerStarted","Data":"460ab77646b70f3dc5b59b95169f767e3f0fc470ba3077927971f7c81269486b"} Jul 08 16:36:28.878814 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:28.878764 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n8gml" podStartSLOduration=130.771332126 podStartE2EDuration="2m11.878749384s" totalImagesPullingTime="1.107417258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:36:28.877167245 +0000 UTC m=+132.158877311" watchObservedRunningTime="2026-07-08 16:36:28.878749384 +0000 UTC m=+132.160459455" Jul 08 16:36:38.186279 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.186235 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-789dc9dccd-lxb67" podUID="1b9277b5-d267-40bf-8fc2-302c871ea810" containerName="console" containerID="cri-o://79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0" gracePeriod=15 Jul 08 16:36:38.432902 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.432879 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:38.570975 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.570892 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtwm6\" (UniqueName: \"kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.570975 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.570930 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.570975 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.570965 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.571267 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.570991 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.571267 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571027 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.571267 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571061 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.571267 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571096 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config\") pod \"1b9277b5-d267-40bf-8fc2-302c871ea810\" (UID: \"1b9277b5-d267-40bf-8fc2-302c871ea810\") " Jul 08 16:36:38.571469 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571419 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config" (OuterVolumeSpecName: "console-config") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:38.571528 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571477 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:38.571582 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571523 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:38.571582 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.571548 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:36:38.573189 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.573164 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:38.573312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.573245 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:36:38.573312 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.573293 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6" (OuterVolumeSpecName: "kube-api-access-mtwm6") pod "1b9277b5-d267-40bf-8fc2-302c871ea810" (UID: "1b9277b5-d267-40bf-8fc2-302c871ea810"). InnerVolumeSpecName "kube-api-access-mtwm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:36:38.671980 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.671939 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtwm6\" (UniqueName: \"kubernetes.io/projected/1b9277b5-d267-40bf-8fc2-302c871ea810-kube-api-access-mtwm6\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.671980 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.671974 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-console-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.671980 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.671990 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-service-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.672221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.672001 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-oauth-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.672221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.672013 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.672221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.672024 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9277b5-d267-40bf-8fc2-302c871ea810-trusted-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.672221 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.672035 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9277b5-d267-40bf-8fc2-302c871ea810-console-oauth-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:36:38.898536 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.898505 2577 generic.go:356] "Generic (PLEG): container finished" podID="1b9277b5-d267-40bf-8fc2-302c871ea810" containerID="79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0" exitCode=0 Jul 08 16:36:38.898743 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.898552 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dc9dccd-lxb67" Jul 08 16:36:38.898743 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.898570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dc9dccd-lxb67" event={"ID":"1b9277b5-d267-40bf-8fc2-302c871ea810","Type":"ContainerDied","Data":"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0"} Jul 08 16:36:38.898743 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.898639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dc9dccd-lxb67" event={"ID":"1b9277b5-d267-40bf-8fc2-302c871ea810","Type":"ContainerDied","Data":"c71f2d368a7bbcd9212d48c7c2164f0697721cd8f262e8621325f2710a14944d"} Jul 08 16:36:38.898743 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.898660 2577 scope.go:117] "RemoveContainer" containerID="79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0" Jul 08 16:36:38.906803 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.906781 2577 scope.go:117] "RemoveContainer" containerID="79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0" Jul 08 16:36:38.907079 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:36:38.907061 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0\": container with ID starting with 79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0 not found: ID does not exist" containerID="79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0" Jul 08 16:36:38.907128 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.907089 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0"} err="failed to get container status \"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0\": rpc error: code = NotFound desc = could not find container \"79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0\": container with ID starting with 79454b2ed4db1d422ed653fd958c73d31ac1267b1aac31e89b846bbd8ecab3a0 not found: ID does not exist" Jul 08 16:36:38.919603 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.919582 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:38.923953 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:38.923934 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789dc9dccd-lxb67"] Jul 08 16:36:39.339210 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:39.339132 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9277b5-d267-40bf-8fc2-302c871ea810" path="/var/lib/kubelet/pods/1b9277b5-d267-40bf-8fc2-302c871ea810/volumes" Jul 08 16:36:47.294863 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:47.294832 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:36:47.298694 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:36:47.298670 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-875cf55d6-x6k5j" Jul 08 16:37:32.095034 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095001 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095259 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9277b5-d267-40bf-8fc2-302c871ea810" containerName="console" Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095269 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9277b5-d267-40bf-8fc2-302c871ea810" containerName="console" Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095299 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eea2c8d-2e02-4bad-af72-29dc2105d723" containerName="console" Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095305 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eea2c8d-2e02-4bad-af72-29dc2105d723" containerName="console" Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095346 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9277b5-d267-40bf-8fc2-302c871ea810" containerName="console" Jul 08 16:37:32.095571 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.095354 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eea2c8d-2e02-4bad-af72-29dc2105d723" containerName="console" Jul 08 16:37:32.099904 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.099877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.109561 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.109538 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:37:32.169696 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.169891 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcz5x\" (UniqueName: \"kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.169891 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.169891 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.169891 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.170057 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.170057 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.169970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270561 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcz5x\" (UniqueName: \"kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.270790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.270779 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.271393 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.271364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.271567 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.271418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.271567 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.271547 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.271723 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.271569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.273268 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.273243 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.273348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.273280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.280117 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.280096 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcz5x\" (UniqueName: \"kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x\") pod \"console-6db6d586d-hcmcq\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.409950 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.409914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:32.536879 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:32.536846 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:37:32.539715 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:37:32.539673 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cbabdf_17a2_4663_8966_faf7f2c58ae1.slice/crio-3c5a898f3f4e30c9ed50b786fc24fc8a63614cb2b7e4246c763baf85266615f7 WatchSource:0}: Error finding container 3c5a898f3f4e30c9ed50b786fc24fc8a63614cb2b7e4246c763baf85266615f7: Status 404 returned error can't find the container with id 3c5a898f3f4e30c9ed50b786fc24fc8a63614cb2b7e4246c763baf85266615f7 Jul 08 16:37:33.091178 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:33.091141 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db6d586d-hcmcq" event={"ID":"e1cbabdf-17a2-4663-8966-faf7f2c58ae1","Type":"ContainerStarted","Data":"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b"} Jul 08 16:37:33.091384 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:33.091195 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db6d586d-hcmcq" event={"ID":"e1cbabdf-17a2-4663-8966-faf7f2c58ae1","Type":"ContainerStarted","Data":"3c5a898f3f4e30c9ed50b786fc24fc8a63614cb2b7e4246c763baf85266615f7"} Jul 08 16:37:33.111366 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:33.111318 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6db6d586d-hcmcq" podStartSLOduration=1.111301654 podStartE2EDuration="1.111301654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:37:33.110227508 +0000 UTC m=+196.391937592" watchObservedRunningTime="2026-07-08 16:37:33.111301654 +0000 UTC m=+196.393011727" Jul 08 16:37:42.411036 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:42.410987 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:42.411594 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:42.411075 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:42.415931 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:42.415913 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:43.129220 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:43.129192 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:37:43.179212 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:37:43.179180 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:38:08.205246 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.205182 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67b84bcbfb-bd6gr" podUID="1692216d-522e-45c7-8651-37fe14483d15" containerName="console" containerID="cri-o://0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee" gracePeriod=15 Jul 08 16:38:08.441377 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.441355 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:38:08.556608 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556608 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556559 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh6w6\" (UniqueName: \"kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556608 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556590 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556903 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556617 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556903 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556642 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556903 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.556903 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.556777 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle\") pod \"1692216d-522e-45c7-8651-37fe14483d15\" (UID: \"1692216d-522e-45c7-8651-37fe14483d15\") " Jul 08 16:38:08.557089 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.557018 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:08.557089 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.557075 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config" (OuterVolumeSpecName: "console-config") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:08.557194 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.557090 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca" (OuterVolumeSpecName: "service-ca") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:08.557354 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.557331 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:38:08.558842 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.558817 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6" (OuterVolumeSpecName: "kube-api-access-kh6w6") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "kube-api-access-kh6w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:38:08.558937 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.558925 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:38:08.558998 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.558946 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1692216d-522e-45c7-8651-37fe14483d15" (UID: "1692216d-522e-45c7-8651-37fe14483d15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:38:08.657632 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657598 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-trusted-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657632 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657626 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-oauth-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657632 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657635 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh6w6\" (UniqueName: \"kubernetes.io/projected/1692216d-522e-45c7-8651-37fe14483d15-kube-api-access-kh6w6\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657881 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657643 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657881 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657652 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-console-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657881 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657660 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1692216d-522e-45c7-8651-37fe14483d15-service-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:08.657881 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:08.657668 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1692216d-522e-45c7-8651-37fe14483d15-console-oauth-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:38:09.218154 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.218122 2577 generic.go:356] "Generic (PLEG): container finished" podID="1692216d-522e-45c7-8651-37fe14483d15" containerID="0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee" exitCode=0 Jul 08 16:38:09.218546 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.218165 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b84bcbfb-bd6gr" Jul 08 16:38:09.218546 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.218213 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84bcbfb-bd6gr" event={"ID":"1692216d-522e-45c7-8651-37fe14483d15","Type":"ContainerDied","Data":"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee"} Jul 08 16:38:09.218546 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.218286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b84bcbfb-bd6gr" event={"ID":"1692216d-522e-45c7-8651-37fe14483d15","Type":"ContainerDied","Data":"8255ec24540654b263fc8ccd61521352cba67135a34c9a020974c7571de9164a"} Jul 08 16:38:09.218546 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.218307 2577 scope.go:117] "RemoveContainer" containerID="0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee" Jul 08 16:38:09.226487 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.226472 2577 scope.go:117] "RemoveContainer" containerID="0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee" Jul 08 16:38:09.226755 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:38:09.226733 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee\": container with ID starting with 0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee not found: ID does not exist" containerID="0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee" Jul 08 16:38:09.226831 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.226763 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee"} err="failed to get container status \"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee\": rpc error: code = NotFound desc = could not find container \"0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee\": container with ID starting with 0e0fffa5a8b99d833a895a3d706d7411564e75b0dadb9db5c59033d64036d4ee not found: ID does not exist" Jul 08 16:38:09.239725 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.239689 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:38:09.245038 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.245020 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b84bcbfb-bd6gr"] Jul 08 16:38:09.339306 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:09.339276 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1692216d-522e-45c7-8651-37fe14483d15" path="/var/lib/kubelet/pods/1692216d-522e-45c7-8651-37fe14483d15/volumes" Jul 08 16:38:59.285685 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.285651 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb"] Jul 08 16:38:59.286127 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.285909 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1692216d-522e-45c7-8651-37fe14483d15" containerName="console" Jul 08 16:38:59.286127 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.285920 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1692216d-522e-45c7-8651-37fe14483d15" containerName="console" Jul 08 16:38:59.286127 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.285975 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1692216d-522e-45c7-8651-37fe14483d15" containerName="console" Jul 08 16:38:59.289076 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.289059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.291091 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.291066 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:38:59.291202 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.291066 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:38:59.291634 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.291619 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qqthk\"" Jul 08 16:38:59.299207 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.299149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb"] Jul 08 16:38:59.363287 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.363260 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.363287 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.363293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.363524 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.363408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hl47\" (UniqueName: \"kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.463753 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.463700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.463918 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.463816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hl47\" (UniqueName: \"kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.463918 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.463863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.464194 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.464169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.464194 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.464185 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.473125 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.473092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hl47\" (UniqueName: \"kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.598389 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.598308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:38:59.723796 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:38:59.723648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb"] Jul 08 16:38:59.726474 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:38:59.726443 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1c46f3_ba82_4b71_b45b_cbf10ccc671a.slice/crio-025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260 WatchSource:0}: Error finding container 025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260: Status 404 returned error can't find the container with id 025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260 Jul 08 16:39:00.398120 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:00.398086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" event={"ID":"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a","Type":"ContainerStarted","Data":"025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260"} Jul 08 16:39:05.421069 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:05.421031 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerID="56ede077d1bdbd969fb37aab4271a169a5b3ff429df70353410106df32b98d3b" exitCode=0 Jul 08 16:39:05.421458 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:05.421115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" event={"ID":"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a","Type":"ContainerDied","Data":"56ede077d1bdbd969fb37aab4271a169a5b3ff429df70353410106df32b98d3b"} Jul 08 16:39:07.430976 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:07.430937 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerID="8c3828d862c13dc186413fbda3be08a34b16d3833574cbf78cc8659e070fe6e2" exitCode=0 Jul 08 16:39:07.431344 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:07.431000 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" event={"ID":"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a","Type":"ContainerDied","Data":"8c3828d862c13dc186413fbda3be08a34b16d3833574cbf78cc8659e070fe6e2"} Jul 08 16:39:13.455493 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:13.455409 2577 generic.go:356] "Generic (PLEG): container finished" podID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerID="c6078dd162a8cb109bb00b51a6c5216aae243c8fa81d675687aa84076a62aefc" exitCode=0 Jul 08 16:39:13.455856 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:13.455498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" event={"ID":"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a","Type":"ContainerDied","Data":"c6078dd162a8cb109bb00b51a6c5216aae243c8fa81d675687aa84076a62aefc"} Jul 08 16:39:14.586348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.586324 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:39:14.697239 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.697207 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hl47\" (UniqueName: \"kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47\") pod \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " Jul 08 16:39:14.697411 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.697303 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util\") pod \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " Jul 08 16:39:14.697411 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.697324 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle\") pod \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\" (UID: \"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a\") " Jul 08 16:39:14.697977 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.697952 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle" (OuterVolumeSpecName: "bundle") pod "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" (UID: "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:39:14.699410 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.699387 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47" (OuterVolumeSpecName: "kube-api-access-4hl47") pod "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" (UID: "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a"). InnerVolumeSpecName "kube-api-access-4hl47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:39:14.702733 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.702695 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util" (OuterVolumeSpecName: "util") pod "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" (UID: "6b1c46f3-ba82-4b71-b45b-cbf10ccc671a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:39:14.798027 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.797941 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-util\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:39:14.798027 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.797971 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:39:14.798027 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:14.797980 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hl47\" (UniqueName: \"kubernetes.io/projected/6b1c46f3-ba82-4b71-b45b-cbf10ccc671a-kube-api-access-4hl47\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:39:15.464419 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:15.464384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" event={"ID":"6b1c46f3-ba82-4b71-b45b-cbf10ccc671a","Type":"ContainerDied","Data":"025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260"} Jul 08 16:39:15.464577 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:15.464426 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb5895jtfb" Jul 08 16:39:15.464577 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:15.464430 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="025eb3e61af51b7e6b216aad4fd68a22a362067f269ccb4002aa6e2ed9b46260" Jul 08 16:39:17.115809 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:17.115782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:39:17.123423 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:17.123403 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:39:17.124746 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:17.124730 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:39:29.430470 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430432 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-jk7j9"] Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430815 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="extract" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430836 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="extract" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430861 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="util" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430871 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="util" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430883 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="pull" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430890 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="pull" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.430958 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1c46f3-ba82-4b71-b45b-cbf10ccc671a" containerName="extract" Jul 08 16:39:29.434201 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.434203 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.436471 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.436453 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 08 16:39:29.436596 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.436581 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 08 16:39:29.436648 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.436609 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-f9b2b\"" Jul 08 16:39:29.436699 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.436659 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 08 16:39:29.437104 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.437087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 08 16:39:29.437219 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.437092 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 08 16:39:29.450036 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.450014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jk7j9"] Jul 08 16:39:29.515280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.515246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lsff\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-kube-api-access-9lsff\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.515280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.515279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.515525 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.515374 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0eb27cca-1c1a-48ed-903a-8e1853289ac5-cabundle0\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.615952 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.615909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0eb27cca-1c1a-48ed-903a-8e1853289ac5-cabundle0\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.616120 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.615969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lsff\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-kube-api-access-9lsff\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.616120 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.616000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.616191 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:29.616141 2577 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 08 16:39:29.616191 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:29.616158 2577 secret.go:281] references non-existent secret key: ca.crt Jul 08 16:39:29.616191 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:29.616168 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 08 16:39:29.616191 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:29.616182 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-jk7j9: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 08 16:39:29.616313 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:29.616250 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates podName:0eb27cca-1c1a-48ed-903a-8e1853289ac5 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:30.116230457 +0000 UTC m=+313.397940510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates") pod "keda-operator-68bff59c-jk7j9" (UID: "0eb27cca-1c1a-48ed-903a-8e1853289ac5") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 08 16:39:29.616573 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.616554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/0eb27cca-1c1a-48ed-903a-8e1853289ac5-cabundle0\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:29.625987 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:29.625962 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lsff\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-kube-api-access-9lsff\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:30.120668 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.120628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:30.120863 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.120770 2577 secret.go:281] references non-existent secret key: ca.crt Jul 08 16:39:30.120863 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.120786 2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 08 16:39:30.120863 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.120794 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-jk7j9: references non-existent secret key: ca.crt Jul 08 16:39:30.120863 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.120841 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates podName:0eb27cca-1c1a-48ed-903a-8e1853289ac5 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:31.120827512 +0000 UTC m=+314.402537561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates") pod "keda-operator-68bff59c-jk7j9" (UID: "0eb27cca-1c1a-48ed-903a-8e1853289ac5") : references non-existent secret key: ca.crt Jul 08 16:39:30.504948 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.504866 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w57jc"] Jul 08 16:39:30.507033 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.507018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:30.509486 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.509458 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 08 16:39:30.524562 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.524528 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w57jc"] Jul 08 16:39:30.624036 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.623993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:30.624235 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.624123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75jt\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-kube-api-access-v75jt\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:30.724945 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.724908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:30.725136 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.724998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75jt\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-kube-api-access-v75jt\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:30.725136 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.725062 2577 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 08 16:39:30.725136 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.725089 2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-w57jc: secret "keda-admission-webhooks-certs" not found Jul 08 16:39:30.725312 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:39:30.725142 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates podName:59979370-ec89-4d6e-ada8-4cdf6bb48bc5 nodeName:}" failed. No retries permitted until 2026-07-08 16:39:31.225127024 +0000 UTC m=+314.506837073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates") pod "keda-admission-5fbd5c4644-w57jc" (UID: "59979370-ec89-4d6e-ada8-4cdf6bb48bc5") : secret "keda-admission-webhooks-certs" not found Jul 08 16:39:30.736647 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:30.736620 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75jt\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-kube-api-access-v75jt\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:31.129031 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.128991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:31.131415 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.131395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/0eb27cca-1c1a-48ed-903a-8e1853289ac5-certificates\") pod \"keda-operator-68bff59c-jk7j9\" (UID: \"0eb27cca-1c1a-48ed-903a-8e1853289ac5\") " pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:31.229656 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.229622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:31.232000 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.231969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/59979370-ec89-4d6e-ada8-4cdf6bb48bc5-certificates\") pod \"keda-admission-5fbd5c4644-w57jc\" (UID: \"59979370-ec89-4d6e-ada8-4cdf6bb48bc5\") " pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:31.243856 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.243834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:31.386928 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.386836 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-jk7j9"] Jul 08 16:39:31.390679 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:39:31.390649 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb27cca_1c1a_48ed_903a_8e1853289ac5.slice/crio-d63ce944e13dcd6d391cc96e547b8151b5d7828f47db5d43da6f5f206b1847f0 WatchSource:0}: Error finding container d63ce944e13dcd6d391cc96e547b8151b5d7828f47db5d43da6f5f206b1847f0: Status 404 returned error can't find the container with id d63ce944e13dcd6d391cc96e547b8151b5d7828f47db5d43da6f5f206b1847f0 Jul 08 16:39:31.392075 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.392054 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:39:31.418532 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.418512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:31.523460 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.523427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jk7j9" event={"ID":"0eb27cca-1c1a-48ed-903a-8e1853289ac5","Type":"ContainerStarted","Data":"d63ce944e13dcd6d391cc96e547b8151b5d7828f47db5d43da6f5f206b1847f0"} Jul 08 16:39:31.549348 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:31.549318 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w57jc"] Jul 08 16:39:31.552325 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:39:31.552297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59979370_ec89_4d6e_ada8_4cdf6bb48bc5.slice/crio-a8765dc1c460eb20385035da2d7cb79b2eb0d4e708d8155eaafffd0dcce16776 WatchSource:0}: Error finding container a8765dc1c460eb20385035da2d7cb79b2eb0d4e708d8155eaafffd0dcce16776: Status 404 returned error can't find the container with id a8765dc1c460eb20385035da2d7cb79b2eb0d4e708d8155eaafffd0dcce16776 Jul 08 16:39:32.529306 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:32.529264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" event={"ID":"59979370-ec89-4d6e-ada8-4cdf6bb48bc5","Type":"ContainerStarted","Data":"a8765dc1c460eb20385035da2d7cb79b2eb0d4e708d8155eaafffd0dcce16776"} Jul 08 16:39:33.535134 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:33.535093 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" event={"ID":"59979370-ec89-4d6e-ada8-4cdf6bb48bc5","Type":"ContainerStarted","Data":"cb1982ac6558e24f4b4db5942a089013dba0b4c78717359118df9e60fab8e728"} Jul 08 16:39:33.535617 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:33.535228 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:33.556850 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:33.556798 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" podStartSLOduration=2.271835583 podStartE2EDuration="3.556781411s" totalImagesPullingTime="1.284945828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:33.555761603 +0000 UTC m=+316.837471674" watchObservedRunningTime="2026-07-08 16:39:33.556781411 +0000 UTC m=+316.838491484" Jul 08 16:39:34.540890 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:34.540805 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-jk7j9" event={"ID":"0eb27cca-1c1a-48ed-903a-8e1853289ac5","Type":"ContainerStarted","Data":"20849b18af2eaa5f3cfb7f63fcd128899359b8ae8a748ea4dbe97e0259551ea3"} Jul 08 16:39:34.567108 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:34.567057 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-jk7j9" podStartSLOduration=2.825850549 podStartE2EDuration="5.567041461s" totalImagesPullingTime="2.741190912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:39:34.566632278 +0000 UTC m=+317.848342356" watchObservedRunningTime="2026-07-08 16:39:34.567041461 +0000 UTC m=+317.848751534" Jul 08 16:39:35.544960 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:35.544935 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:39:54.543582 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:54.543552 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-w57jc" Jul 08 16:39:56.549902 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:39:56.549874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-jk7j9" Jul 08 16:40:33.819136 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.819106 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:40:33.821555 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.821538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:33.823464 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.823443 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-fq5xh\"" Jul 08 16:40:33.823575 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.823490 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 08 16:40:33.824000 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.823985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 08 16:40:33.824000 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.824002 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 08 16:40:33.835612 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.835588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:40:33.873487 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.873453 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-kpsj8"] Jul 08 16:40:33.875839 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.875825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:33.877658 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.877640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 08 16:40:33.877790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.877659 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-cjbv7\"" Jul 08 16:40:33.885666 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.885646 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-kpsj8"] Jul 08 16:40:33.941492 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.941453 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld29k\" (UniqueName: \"kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:33.941671 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:33.941513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.042656 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.042626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.042842 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.042677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdp9\" (UniqueName: \"kubernetes.io/projected/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-kube-api-access-vfdp9\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.042842 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.042734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-data\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.042842 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.042754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld29k\" (UniqueName: \"kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.045233 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.045190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.051576 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.051553 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld29k\" (UniqueName: \"kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k\") pod \"kserve-controller-manager-c8c545f5f-cvpmd\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.132258 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.132227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:34.143455 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.143431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-data\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.143549 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.143521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdp9\" (UniqueName: \"kubernetes.io/projected/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-kube-api-access-vfdp9\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.143790 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.143768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-data\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.152833 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.152811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdp9\" (UniqueName: \"kubernetes.io/projected/aa56c86a-531a-4fd8-ba2c-6a607a0d827d-kube-api-access-vfdp9\") pod \"seaweedfs-64568bcd49-kpsj8\" (UID: \"aa56c86a-531a-4fd8-ba2c-6a607a0d827d\") " pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.184866 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.184841 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:34.269971 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.269941 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:40:34.272602 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:40:34.272576 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfed2bbe_9a73_4c1a_bdd9_14189e30ea6c.slice/crio-8c0e55d6fedfd80ece28ab5afcf829f2d9620d3d8b7fb0fba2fe8cb2e4d531a6 WatchSource:0}: Error finding container 8c0e55d6fedfd80ece28ab5afcf829f2d9620d3d8b7fb0fba2fe8cb2e4d531a6: Status 404 returned error can't find the container with id 8c0e55d6fedfd80ece28ab5afcf829f2d9620d3d8b7fb0fba2fe8cb2e4d531a6 Jul 08 16:40:34.319138 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.319115 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-kpsj8"] Jul 08 16:40:34.321841 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:40:34.321818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa56c86a_531a_4fd8_ba2c_6a607a0d827d.slice/crio-bbd957f83614dc5c2c7cc1c2b715746b9a4599b89afd6839de4e36e8734e8ed2 WatchSource:0}: Error finding container bbd957f83614dc5c2c7cc1c2b715746b9a4599b89afd6839de4e36e8734e8ed2: Status 404 returned error can't find the container with id bbd957f83614dc5c2c7cc1c2b715746b9a4599b89afd6839de4e36e8734e8ed2 Jul 08 16:40:34.762088 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.762049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" event={"ID":"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c","Type":"ContainerStarted","Data":"8c0e55d6fedfd80ece28ab5afcf829f2d9620d3d8b7fb0fba2fe8cb2e4d531a6"} Jul 08 16:40:34.763440 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:34.763411 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-kpsj8" event={"ID":"aa56c86a-531a-4fd8-ba2c-6a607a0d827d","Type":"ContainerStarted","Data":"bbd957f83614dc5c2c7cc1c2b715746b9a4599b89afd6839de4e36e8734e8ed2"} Jul 08 16:40:37.777413 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:37.777362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" event={"ID":"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c","Type":"ContainerStarted","Data":"607d6346fe456a774033bb1d6d9bdf7256a834dd928936b4ec57c1b695f155a8"} Jul 08 16:40:37.777863 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:37.777475 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:40:37.798650 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:37.798578 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" podStartSLOduration=2.250529431 podStartE2EDuration="4.798560267s" totalImagesPullingTime="2.548030836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:37.797963951 +0000 UTC m=+381.079674023" watchObservedRunningTime="2026-07-08 16:40:37.798560267 +0000 UTC m=+381.080270338" Jul 08 16:40:38.783081 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:38.783050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-kpsj8" event={"ID":"aa56c86a-531a-4fd8-ba2c-6a607a0d827d","Type":"ContainerStarted","Data":"2cfeb3dd01709e160aa303ab629ad27c41a8eed2de3cd927faa12dd418267d20"} Jul 08 16:40:38.783478 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:38.783227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:40:38.800556 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:38.800509 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-kpsj8" podStartSLOduration=1.804831682 podStartE2EDuration="5.800493155s" totalImagesPullingTime="3.995661473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:40:38.799263045 +0000 UTC m=+382.080973115" watchObservedRunningTime="2026-07-08 16:40:38.800493155 +0000 UTC m=+382.082203225" Jul 08 16:40:44.790121 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:40:44.790087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-kpsj8" Jul 08 16:41:08.788910 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:08.788874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:41:10.721626 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.721586 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:41:10.722118 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.721881 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" podUID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" containerName="manager" containerID="cri-o://607d6346fe456a774033bb1d6d9bdf7256a834dd928936b4ec57c1b695f155a8" gracePeriod=10 Jul 08 16:41:10.752810 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.752786 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-fpqnp"] Jul 08 16:41:10.754758 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.754744 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.768438 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.768411 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-fpqnp"] Jul 08 16:41:10.820767 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.820740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-cert\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.820889 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.820857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zt4\" (UniqueName: \"kubernetes.io/projected/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-kube-api-access-76zt4\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.902918 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.902890 2577 generic.go:356] "Generic (PLEG): container finished" podID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" containerID="607d6346fe456a774033bb1d6d9bdf7256a834dd928936b4ec57c1b695f155a8" exitCode=0 Jul 08 16:41:10.903092 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.902971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" event={"ID":"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c","Type":"ContainerDied","Data":"607d6346fe456a774033bb1d6d9bdf7256a834dd928936b4ec57c1b695f155a8"} Jul 08 16:41:10.921428 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.921396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zt4\" (UniqueName: \"kubernetes.io/projected/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-kube-api-access-76zt4\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.921581 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.921461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-cert\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.923854 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.923830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-cert\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.931297 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.931272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zt4\" (UniqueName: \"kubernetes.io/projected/2ea8f183-ed49-4ff3-a9bb-07daf4511f4d-kube-api-access-76zt4\") pod \"kserve-controller-manager-c8c545f5f-fpqnp\" (UID: \"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d\") " pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:10.952927 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:10.952910 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:41:11.022503 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.022427 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld29k\" (UniqueName: \"kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k\") pod \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " Jul 08 16:41:11.022503 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.022463 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert\") pod \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\" (UID: \"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c\") " Jul 08 16:41:11.024648 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.024613 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert" (OuterVolumeSpecName: "cert") pod "cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" (UID: "cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:11.024775 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.024669 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k" (OuterVolumeSpecName: "kube-api-access-ld29k") pod "cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" (UID: "cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c"). InnerVolumeSpecName "kube-api-access-ld29k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:11.097159 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.097120 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:11.123699 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.123669 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld29k\" (UniqueName: \"kubernetes.io/projected/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-kube-api-access-ld29k\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:11.123851 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.123697 2577 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:11.225370 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.225346 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-fpqnp"] Jul 08 16:41:11.227552 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:41:11.227516 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea8f183_ed49_4ff3_a9bb_07daf4511f4d.slice/crio-f867d4ecceb79860d0fc7d17ea7b714af27cc02ca1c5c923a62d97cf3fea1bad WatchSource:0}: Error finding container f867d4ecceb79860d0fc7d17ea7b714af27cc02ca1c5c923a62d97cf3fea1bad: Status 404 returned error can't find the container with id f867d4ecceb79860d0fc7d17ea7b714af27cc02ca1c5c923a62d97cf3fea1bad Jul 08 16:41:11.907868 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.907840 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" Jul 08 16:41:11.908309 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.907839 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-cvpmd" event={"ID":"cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c","Type":"ContainerDied","Data":"8c0e55d6fedfd80ece28ab5afcf829f2d9620d3d8b7fb0fba2fe8cb2e4d531a6"} Jul 08 16:41:11.908309 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.907977 2577 scope.go:117] "RemoveContainer" containerID="607d6346fe456a774033bb1d6d9bdf7256a834dd928936b4ec57c1b695f155a8" Jul 08 16:41:11.909652 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.909625 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" event={"ID":"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d","Type":"ContainerStarted","Data":"e86b9ec9e8d8dabda8b6c443db3064608bdca6a4fe1a81c75ff31237aa256566"} Jul 08 16:41:11.909796 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.909681 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" event={"ID":"2ea8f183-ed49-4ff3-a9bb-07daf4511f4d","Type":"ContainerStarted","Data":"f867d4ecceb79860d0fc7d17ea7b714af27cc02ca1c5c923a62d97cf3fea1bad"} Jul 08 16:41:11.909796 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.909735 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:11.926053 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.926032 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:41:11.932748 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.932729 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-c8c545f5f-cvpmd"] Jul 08 16:41:11.947387 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:11.947346 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" podStartSLOduration=1.590208596 podStartE2EDuration="1.947331911s" totalImagesPullingTime="357.123315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:11.946167963 +0000 UTC m=+415.227878035" watchObservedRunningTime="2026-07-08 16:41:11.947331911 +0000 UTC m=+415.229041982" Jul 08 16:41:13.339280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:13.339245 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" path="/var/lib/kubelet/pods/cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c/volumes" Jul 08 16:41:16.431311 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.431282 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fbfc649f5-jtjrf"] Jul 08 16:41:16.431670 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.431567 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" containerName="manager" Jul 08 16:41:16.431670 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.431579 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" containerName="manager" Jul 08 16:41:16.431670 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.431622 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfed2bbe-9a73-4c1a-bdd9-14189e30ea6c" containerName="manager" Jul 08 16:41:16.440349 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.440319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.448176 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.448142 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbfc649f5-jtjrf"] Jul 08 16:41:16.466180 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-trusted-ca-bundle\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466304 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-oauth-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466304 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-console-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466304 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8lt6\" (UniqueName: \"kubernetes.io/projected/47287db0-a10f-4a42-a595-310323e7a5fe-kube-api-access-b8lt6\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-oauth-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.466421 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.466395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-service-ca\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567054 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567018 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-console-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567054 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8lt6\" (UniqueName: \"kubernetes.io/projected/47287db0-a10f-4a42-a595-310323e7a5fe-kube-api-access-b8lt6\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567308 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-oauth-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567308 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567308 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-service-ca\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567308 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-trusted-ca-bundle\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567308 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-oauth-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.567972 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-service-ca\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.568090 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567944 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-oauth-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.568090 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.567951 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-console-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.568165 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.568090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47287db0-a10f-4a42-a595-310323e7a5fe-trusted-ca-bundle\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.569536 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.569514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-oauth-config\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.569768 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.569752 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47287db0-a10f-4a42-a595-310323e7a5fe-console-serving-cert\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.576349 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.576329 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8lt6\" (UniqueName: \"kubernetes.io/projected/47287db0-a10f-4a42-a595-310323e7a5fe-kube-api-access-b8lt6\") pod \"console-fbfc649f5-jtjrf\" (UID: \"47287db0-a10f-4a42-a595-310323e7a5fe\") " pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.750097 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.750008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:16.878548 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.878510 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fbfc649f5-jtjrf"] Jul 08 16:41:16.881430 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:41:16.881404 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47287db0_a10f_4a42_a595_310323e7a5fe.slice/crio-83d36def8ab368db407d653550e049946633debe1d33b17164ac4788b13ca4f0 WatchSource:0}: Error finding container 83d36def8ab368db407d653550e049946633debe1d33b17164ac4788b13ca4f0: Status 404 returned error can't find the container with id 83d36def8ab368db407d653550e049946633debe1d33b17164ac4788b13ca4f0 Jul 08 16:41:16.931311 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:16.931272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbfc649f5-jtjrf" event={"ID":"47287db0-a10f-4a42-a595-310323e7a5fe","Type":"ContainerStarted","Data":"83d36def8ab368db407d653550e049946633debe1d33b17164ac4788b13ca4f0"} Jul 08 16:41:17.936671 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:17.936638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fbfc649f5-jtjrf" event={"ID":"47287db0-a10f-4a42-a595-310323e7a5fe","Type":"ContainerStarted","Data":"387f1053836dc30b24804b33abf0434f62ab5e8418d438d7490a890a04f3591a"} Jul 08 16:41:17.955205 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:17.955157 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fbfc649f5-jtjrf" podStartSLOduration=1.9551394069999999 podStartE2EDuration="1.955139407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:17.953938451 +0000 UTC m=+421.235648530" watchObservedRunningTime="2026-07-08 16:41:17.955139407 +0000 UTC m=+421.236849478" Jul 08 16:41:26.750328 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:26.750290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:26.750826 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:26.750385 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:26.755026 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:26.755004 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:26.974686 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:26.974655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fbfc649f5-jtjrf" Jul 08 16:41:27.029506 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:27.029414 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:41:42.918213 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:42.918134 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-c8c545f5f-fpqnp" Jul 08 16:41:44.008977 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.008945 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-r9rdg"] Jul 08 16:41:44.011378 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.011357 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.013521 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.013499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 08 16:41:44.013624 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.013506 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-x7vc2\"" Jul 08 16:41:44.022520 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.022490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-r9rdg"] Jul 08 16:41:44.029587 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.029567 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6bf2z"] Jul 08 16:41:44.034157 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.032995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.035279 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.035259 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-4h476\"" Jul 08 16:41:44.035655 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.035275 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 08 16:41:44.043462 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.043440 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6bf2z"] Jul 08 16:41:44.105925 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.105887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-tls-certs\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.106097 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.105947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvnlj\" (UniqueName: \"kubernetes.io/projected/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-kube-api-access-pvnlj\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.206997 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.206963 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-tls-certs\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.207168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.207004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a2f266-2e1d-4205-a434-7de3c2625daa-cert\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.207168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.207058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvnlj\" (UniqueName: \"kubernetes.io/projected/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-kube-api-access-pvnlj\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.207168 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.207082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbd7t\" (UniqueName: \"kubernetes.io/projected/f2a2f266-2e1d-4205-a434-7de3c2625daa-kube-api-access-dbd7t\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.209595 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.209572 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-tls-certs\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.221841 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.221817 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvnlj\" (UniqueName: \"kubernetes.io/projected/7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5-kube-api-access-pvnlj\") pod \"model-serving-api-fd65d7d6-r9rdg\" (UID: \"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5\") " pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.308087 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.308006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a2f266-2e1d-4205-a434-7de3c2625daa-cert\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.308556 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.308530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbd7t\" (UniqueName: \"kubernetes.io/projected/f2a2f266-2e1d-4205-a434-7de3c2625daa-kube-api-access-dbd7t\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.310761 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.310740 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a2f266-2e1d-4205-a434-7de3c2625daa-cert\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.317844 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.317822 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbd7t\" (UniqueName: \"kubernetes.io/projected/f2a2f266-2e1d-4205-a434-7de3c2625daa-kube-api-access-dbd7t\") pod \"odh-model-controller-84b54b7f97-6bf2z\" (UID: \"f2a2f266-2e1d-4205-a434-7de3c2625daa\") " pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.321689 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.321660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:44.347107 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.347086 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:44.474943 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.474915 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-r9rdg"] Jul 08 16:41:44.477630 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:41:44.477599 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c38fe71_4ef0_419f_a3e0_cf9b9e13cba5.slice/crio-62f45bf5e499b81f342caa32f5c82a4401040bbc9de14e7cbeffd92b7b713bc6 WatchSource:0}: Error finding container 62f45bf5e499b81f342caa32f5c82a4401040bbc9de14e7cbeffd92b7b713bc6: Status 404 returned error can't find the container with id 62f45bf5e499b81f342caa32f5c82a4401040bbc9de14e7cbeffd92b7b713bc6 Jul 08 16:41:44.500427 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:44.500400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-6bf2z"] Jul 08 16:41:44.503132 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:41:44.503107 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a2f266_2e1d_4205_a434_7de3c2625daa.slice/crio-d70747110c0257174a33e71c1083c2e9c52fa91bb048fd3f4f837e0d286ab485 WatchSource:0}: Error finding container d70747110c0257174a33e71c1083c2e9c52fa91bb048fd3f4f837e0d286ab485: Status 404 returned error can't find the container with id d70747110c0257174a33e71c1083c2e9c52fa91bb048fd3f4f837e0d286ab485 Jul 08 16:41:45.045076 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:45.045041 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-r9rdg" event={"ID":"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5","Type":"ContainerStarted","Data":"62f45bf5e499b81f342caa32f5c82a4401040bbc9de14e7cbeffd92b7b713bc6"} Jul 08 16:41:45.046442 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:45.046389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" event={"ID":"f2a2f266-2e1d-4205-a434-7de3c2625daa","Type":"ContainerStarted","Data":"d70747110c0257174a33e71c1083c2e9c52fa91bb048fd3f4f837e0d286ab485"} Jul 08 16:41:48.063085 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.063049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" event={"ID":"f2a2f266-2e1d-4205-a434-7de3c2625daa","Type":"ContainerStarted","Data":"163d160ea538f46da6e64832b6523d7c83022d034d81acea46671b16133cdb31"} Jul 08 16:41:48.063552 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.063156 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:48.064550 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.064532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-r9rdg" event={"ID":"7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5","Type":"ContainerStarted","Data":"6cdb8a1ec2f359f3b5b1e268f22117f8102fb340d09780a41b61fd611bbb6e8d"} Jul 08 16:41:48.064630 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.064607 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:41:48.079813 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.079770 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" podStartSLOduration=1.3691569129999999 podStartE2EDuration="4.079757524s" totalImagesPullingTime="2.710600611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:48.079052582 +0000 UTC m=+451.360762654" watchObservedRunningTime="2026-07-08 16:41:48.079757524 +0000 UTC m=+451.361467592" Jul 08 16:41:48.096068 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:48.096021 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-r9rdg" podStartSLOduration=2.391244354 podStartE2EDuration="5.096006906s" totalImagesPullingTime="2.704762552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:41:48.095029452 +0000 UTC m=+451.376739522" watchObservedRunningTime="2026-07-08 16:41:48.096006906 +0000 UTC m=+451.377716976" Jul 08 16:41:52.050233 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.050200 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6db6d586d-hcmcq" podUID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" containerName="console" containerID="cri-o://8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b" gracePeriod=15 Jul 08 16:41:52.309504 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.309453 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:41:52.386540 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386509 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386693 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386558 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386693 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386584 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386693 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386614 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386693 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386647 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386923 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386694 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcz5x\" (UniqueName: \"kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.386923 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386756 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config\") pod \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\" (UID: \"e1cbabdf-17a2-4663-8966-faf7f2c58ae1\") " Jul 08 16:41:52.387017 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.386969 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:52.387072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.387011 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:52.387072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.387017 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config" (OuterVolumeSpecName: "console-config") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:52.387072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.387057 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:41:52.388858 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.388832 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:52.388972 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.388870 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x" (OuterVolumeSpecName: "kube-api-access-wcz5x") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "kube-api-access-wcz5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:41:52.388972 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.388910 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1cbabdf-17a2-4663-8966-faf7f2c58ae1" (UID: "e1cbabdf-17a2-4663-8966-faf7f2c58ae1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:41:52.487280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487251 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-oauth-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487274 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-trusted-ca-bundle\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487280 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487286 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-serving-cert\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487477 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487297 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcz5x\" (UniqueName: \"kubernetes.io/projected/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-kube-api-access-wcz5x\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487477 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487310 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-oauth-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487477 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487320 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-service-ca\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:52.487477 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:52.487331 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1cbabdf-17a2-4663-8966-faf7f2c58ae1-console-config\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:41:53.085186 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.085147 2577 generic.go:356] "Generic (PLEG): container finished" podID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" containerID="8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b" exitCode=0 Jul 08 16:41:53.085676 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.085212 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db6d586d-hcmcq" Jul 08 16:41:53.085676 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.085241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db6d586d-hcmcq" event={"ID":"e1cbabdf-17a2-4663-8966-faf7f2c58ae1","Type":"ContainerDied","Data":"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b"} Jul 08 16:41:53.085676 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.085344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db6d586d-hcmcq" event={"ID":"e1cbabdf-17a2-4663-8966-faf7f2c58ae1","Type":"ContainerDied","Data":"3c5a898f3f4e30c9ed50b786fc24fc8a63614cb2b7e4246c763baf85266615f7"} Jul 08 16:41:53.085676 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.085376 2577 scope.go:117] "RemoveContainer" containerID="8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b" Jul 08 16:41:53.093822 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.093802 2577 scope.go:117] "RemoveContainer" containerID="8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b" Jul 08 16:41:53.094086 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:41:53.094064 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b\": container with ID starting with 8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b not found: ID does not exist" containerID="8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b" Jul 08 16:41:53.094142 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.094098 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b"} err="failed to get container status \"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b\": rpc error: code = NotFound desc = could not find container \"8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b\": container with ID starting with 8ce1944ae0678b00ca368ac7db386c836227f49e97ea6ec12a5fb5813a7e2f6b not found: ID does not exist" Jul 08 16:41:53.107294 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.107269 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:41:53.111853 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.111832 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6db6d586d-hcmcq"] Jul 08 16:41:53.339977 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:53.339903 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" path="/var/lib/kubelet/pods/e1cbabdf-17a2-4663-8966-faf7f2c58ae1/volumes" Jul 08 16:41:59.071180 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:59.071155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-6bf2z" Jul 08 16:41:59.072856 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:41:59.072838 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-r9rdg" Jul 08 16:43:20.738103 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.738065 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:20.738668 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.738502 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" containerName="console" Jul 08 16:43:20.738668 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.738522 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" containerName="console" Jul 08 16:43:20.738668 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.738599 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1cbabdf-17a2-4663-8966-faf7f2c58ae1" containerName="console" Jul 08 16:43:20.741374 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.741354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.745587 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.745570 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 08 16:43:20.752342 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.752322 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:20.769736 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.769690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n26ll\" (UniqueName: \"kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.769849 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.769781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.870774 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.870734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n26ll\" (UniqueName: \"kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.870940 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.870809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.871158 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.871142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:20.884431 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:20.884407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n26ll\" (UniqueName: \"kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll\") pod \"seaweedfs-tls-custom-6644bf5d6c-n8n5x\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:21.050078 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:21.049999 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:21.176991 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:21.176966 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:21.178963 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:43:21.178927 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbe4f52_3734_4821_a6e8_f129051e02ee.slice/crio-392d809d75c302fe8b70ca3d829eda1477bede99d47d39f10747f9bfd0402c0e WatchSource:0}: Error finding container 392d809d75c302fe8b70ca3d829eda1477bede99d47d39f10747f9bfd0402c0e: Status 404 returned error can't find the container with id 392d809d75c302fe8b70ca3d829eda1477bede99d47d39f10747f9bfd0402c0e Jul 08 16:43:21.424027 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:21.423994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" event={"ID":"1dbe4f52-3734-4821-a6e8-f129051e02ee","Type":"ContainerStarted","Data":"392d809d75c302fe8b70ca3d829eda1477bede99d47d39f10747f9bfd0402c0e"} Jul 08 16:43:22.430339 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:22.430302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" event={"ID":"1dbe4f52-3734-4821-a6e8-f129051e02ee","Type":"ContainerStarted","Data":"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3"} Jul 08 16:43:22.451115 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:22.451068 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" podStartSLOduration=2.1284649 podStartE2EDuration="2.451052247s" totalImagesPullingTime="322.587347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:43:22.44974332 +0000 UTC m=+545.731453388" watchObservedRunningTime="2026-07-08 16:43:22.451052247 +0000 UTC m=+545.732762317" Jul 08 16:43:23.547515 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:23.547477 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:24.437100 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:24.437065 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" podUID="1dbe4f52-3734-4821-a6e8-f129051e02ee" containerName="seaweedfs-tls-custom" containerID="cri-o://a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3" gracePeriod=30 Jul 08 16:43:52.177072 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.177044 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:52.332234 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.332143 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n26ll\" (UniqueName: \"kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll\") pod \"1dbe4f52-3734-4821-a6e8-f129051e02ee\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " Jul 08 16:43:52.332234 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.332181 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data\") pod \"1dbe4f52-3734-4821-a6e8-f129051e02ee\" (UID: \"1dbe4f52-3734-4821-a6e8-f129051e02ee\") " Jul 08 16:43:52.333603 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.333562 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data" (OuterVolumeSpecName: "data") pod "1dbe4f52-3734-4821-a6e8-f129051e02ee" (UID: "1dbe4f52-3734-4821-a6e8-f129051e02ee"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:43:52.334384 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.334357 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll" (OuterVolumeSpecName: "kube-api-access-n26ll") pod "1dbe4f52-3734-4821-a6e8-f129051e02ee" (UID: "1dbe4f52-3734-4821-a6e8-f129051e02ee"). InnerVolumeSpecName "kube-api-access-n26ll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:43:52.433290 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.433254 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n26ll\" (UniqueName: \"kubernetes.io/projected/1dbe4f52-3734-4821-a6e8-f129051e02ee-kube-api-access-n26ll\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:43:52.433290 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.433290 2577 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1dbe4f52-3734-4821-a6e8-f129051e02ee-data\") on node \"ip-10-0-134-45.ec2.internal\" DevicePath \"\"" Jul 08 16:43:52.551679 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.551650 2577 generic.go:356] "Generic (PLEG): container finished" podID="1dbe4f52-3734-4821-a6e8-f129051e02ee" containerID="a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3" exitCode=0 Jul 08 16:43:52.551834 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.551692 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" Jul 08 16:43:52.551834 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.551738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" event={"ID":"1dbe4f52-3734-4821-a6e8-f129051e02ee","Type":"ContainerDied","Data":"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3"} Jul 08 16:43:52.551834 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.551793 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x" event={"ID":"1dbe4f52-3734-4821-a6e8-f129051e02ee","Type":"ContainerDied","Data":"392d809d75c302fe8b70ca3d829eda1477bede99d47d39f10747f9bfd0402c0e"} Jul 08 16:43:52.551834 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.551819 2577 scope.go:117] "RemoveContainer" containerID="a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3" Jul 08 16:43:52.561433 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.561415 2577 scope.go:117] "RemoveContainer" containerID="a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3" Jul 08 16:43:52.561676 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:43:52.561656 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3\": container with ID starting with a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3 not found: ID does not exist" containerID="a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3" Jul 08 16:43:52.561793 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.561684 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3"} err="failed to get container status \"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3\": rpc error: code = NotFound desc = could not find container \"a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3\": container with ID starting with a59f6d5084d3684e243741227a0d8db543e43e8cb54f4388dd1c128c867468d3 not found: ID does not exist" Jul 08 16:43:52.573245 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.573221 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:52.577899 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.577879 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-n8n5x"] Jul 08 16:43:52.613315 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.613288 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wxxst"] Jul 08 16:43:52.613622 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.613608 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbe4f52-3734-4821-a6e8-f129051e02ee" containerName="seaweedfs-tls-custom" Jul 08 16:43:52.613669 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.613624 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbe4f52-3734-4821-a6e8-f129051e02ee" containerName="seaweedfs-tls-custom" Jul 08 16:43:52.613723 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.613684 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbe4f52-3734-4821-a6e8-f129051e02ee" containerName="seaweedfs-tls-custom" Jul 08 16:43:52.617952 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.617935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.620141 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.620122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 08 16:43:52.620220 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.620122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 08 16:43:52.625115 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.624767 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wxxst"] Jul 08 16:43:52.735938 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.735900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98dc\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-kube-api-access-q98dc\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.736105 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.735964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.736105 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.735986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/342aa2e7-8cc6-41e9-a975-7e700c1695b5-data\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.836782 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.836738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q98dc\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-kube-api-access-q98dc\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.836959 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.836813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.836959 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.836829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/342aa2e7-8cc6-41e9-a975-7e700c1695b5-data\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.837166 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.837152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/342aa2e7-8cc6-41e9-a975-7e700c1695b5-data\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.839190 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.839169 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.846093 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.846072 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98dc\" (UniqueName: \"kubernetes.io/projected/342aa2e7-8cc6-41e9-a975-7e700c1695b5-kube-api-access-q98dc\") pod \"seaweedfs-tls-custom-8b44d767d-wxxst\" (UID: \"342aa2e7-8cc6-41e9-a975-7e700c1695b5\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:52.927746 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:52.927638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" Jul 08 16:43:53.055215 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:53.055155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wxxst"] Jul 08 16:43:53.057669 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:43:53.057642 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342aa2e7_8cc6_41e9_a975_7e700c1695b5.slice/crio-dc9898a97b3c7656d29fe96198e9e9460b4a3dbd173e0718f6e0d85157fa3498 WatchSource:0}: Error finding container dc9898a97b3c7656d29fe96198e9e9460b4a3dbd173e0718f6e0d85157fa3498: Status 404 returned error can't find the container with id dc9898a97b3c7656d29fe96198e9e9460b4a3dbd173e0718f6e0d85157fa3498 Jul 08 16:43:53.340270 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:53.340195 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbe4f52-3734-4821-a6e8-f129051e02ee" path="/var/lib/kubelet/pods/1dbe4f52-3734-4821-a6e8-f129051e02ee/volumes" Jul 08 16:43:53.557535 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:53.557499 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" event={"ID":"342aa2e7-8cc6-41e9-a975-7e700c1695b5","Type":"ContainerStarted","Data":"7a2e8e8baf9fb8ba2fc28b5ebe0860c913008cc419193e4b1d056e1e1c9f800e"} Jul 08 16:43:53.557757 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:53.557551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" event={"ID":"342aa2e7-8cc6-41e9-a975-7e700c1695b5","Type":"ContainerStarted","Data":"dc9898a97b3c7656d29fe96198e9e9460b4a3dbd173e0718f6e0d85157fa3498"} Jul 08 16:43:53.575171 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:43:53.575114 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-wxxst" podStartSLOduration=1.264832711 podStartE2EDuration="1.575096959s" totalImagesPullingTime="310.264248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:43:53.5737791 +0000 UTC m=+576.855489173" watchObservedRunningTime="2026-07-08 16:43:53.575096959 +0000 UTC m=+576.856807030" Jul 08 16:44:06.638108 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.638072 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4"] Jul 08 16:44:06.642734 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.641828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.646998 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.646974 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 08 16:44:06.647117 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.647030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 08 16:44:06.650759 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.650733 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4"] Jul 08 16:44:06.743645 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.743613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.743829 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.743660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvd92\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-kube-api-access-jvd92\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.743829 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.743683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9beb7995-3891-4fe9-8e89-9945a720b076-data\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.844264 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.844224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.844463 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.844274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvd92\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-kube-api-access-jvd92\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.844463 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.844295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9beb7995-3891-4fe9-8e89-9945a720b076-data\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.844463 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:44:06.844355 2577 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 08 16:44:06.844463 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:44:06.844373 2577 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4: secret "seaweedfs-tls-serving" not found Jul 08 16:44:06.844463 ip-10-0-134-45 kubenswrapper[2577]: E0708 16:44:06.844441 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving podName:9beb7995-3891-4fe9-8e89-9945a720b076 nodeName:}" failed. No retries permitted until 2026-07-08 16:44:07.344424038 +0000 UTC m=+590.626134086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-cc8h4" (UID: "9beb7995-3891-4fe9-8e89-9945a720b076") : secret "seaweedfs-tls-serving" not found Jul 08 16:44:06.844766 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.844667 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9beb7995-3891-4fe9-8e89-9945a720b076-data\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:06.854924 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:06.854900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvd92\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-kube-api-access-jvd92\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:07.348317 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:07.348287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:07.350670 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:07.350651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/9beb7995-3891-4fe9-8e89-9945a720b076-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-cc8h4\" (UID: \"9beb7995-3891-4fe9-8e89-9945a720b076\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:07.556909 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:07.556877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" Jul 08 16:44:07.681761 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:07.681734 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4"] Jul 08 16:44:07.685212 ip-10-0-134-45 kubenswrapper[2577]: W0708 16:44:07.685187 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9beb7995_3891_4fe9_8e89_9945a720b076.slice/crio-1373374a3042ba727858d1de8af35fdc30e67f6c4682d34c1e7201bcbac555e1 WatchSource:0}: Error finding container 1373374a3042ba727858d1de8af35fdc30e67f6c4682d34c1e7201bcbac555e1: Status 404 returned error can't find the container with id 1373374a3042ba727858d1de8af35fdc30e67f6c4682d34c1e7201bcbac555e1 Jul 08 16:44:08.623866 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:08.623826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" event={"ID":"9beb7995-3891-4fe9-8e89-9945a720b076","Type":"ContainerStarted","Data":"20b8d51949b6c8fde2c2ec7248d7c12fcaf101dbd8218ba59f02da4a4d382a9f"} Jul 08 16:44:08.624041 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:08.623893 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" event={"ID":"9beb7995-3891-4fe9-8e89-9945a720b076","Type":"ContainerStarted","Data":"1373374a3042ba727858d1de8af35fdc30e67f6c4682d34c1e7201bcbac555e1"} Jul 08 16:44:08.644641 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:08.644587 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-cc8h4" podStartSLOduration=2.360442067 podStartE2EDuration="2.644570544s" totalImagesPullingTime="284.128477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:44:08.643889415 +0000 UTC m=+591.925599487" watchObservedRunningTime="2026-07-08 16:44:08.644570544 +0000 UTC m=+591.926280614" Jul 08 16:44:17.177623 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:17.176460 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:44:17.178587 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:44:17.178564 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:49:17.207594 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:49:17.207562 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:49:17.210034 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:49:17.210008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:54:17.230677 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:54:17.230649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:54:17.233901 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:54:17.233881 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:59:17.253573 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:59:17.253543 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 16:59:17.256920 ip-10-0-134-45 kubenswrapper[2577]: I0708 16:59:17.256900 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 17:00:00.389414 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:00.389379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d59t8_096d2ce7-f666-481f-a7a7-03bbab8947f2/global-pull-secret-syncer/0.log" Jul 08 17:00:00.558516 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:00.558480 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x4x5j_451d0f44-1597-47cf-bde4-ab0795a84742/konnectivity-agent/0.log" Jul 08 17:00:00.611355 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:00.611328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-45.ec2.internal_6f2742cb3cdbcf3416c4ac6825708c8f/haproxy/0.log" Jul 08 17:00:04.910036 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:04.910007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-m8xp4_444b53cb-5891-4499-a486-b733e68e21b9/cluster-monitoring-operator/0.log" Jul 08 17:00:04.935889 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:04.935867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-v5gh9_cfb701a4-5e50-48b5-8143-6e17baf27154/kube-state-metrics/0.log" Jul 08 17:00:04.960602 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:04.960577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-v5gh9_cfb701a4-5e50-48b5-8143-6e17baf27154/kube-rbac-proxy-main/0.log" Jul 08 17:00:04.985932 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:04.985911 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-v5gh9_cfb701a4-5e50-48b5-8143-6e17baf27154/kube-rbac-proxy-self/0.log" Jul 08 17:00:05.026630 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:05.026599 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-875cf55d6-x6k5j_f5a99df4-8e05-49bf-8aa5-10eb3195e4f5/metrics-server/0.log" Jul 08 17:00:05.323175 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:05.323105 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5cfq_f77774b0-85f5-494d-8cf0-b3ede32d61ee/node-exporter/0.log" Jul 08 17:00:05.347456 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:05.347433 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5cfq_f77774b0-85f5-494d-8cf0-b3ede32d61ee/kube-rbac-proxy/0.log" Jul 08 17:00:05.372882 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:05.372859 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x5cfq_f77774b0-85f5-494d-8cf0-b3ede32d61ee/init-textfile/0.log" Jul 08 17:00:05.735949 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:05.735919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-mmjz6_7eb6cbfb-1897-45d0-ae39-eb1b222aef02/prometheus-operator-admission-webhook/0.log" Jul 08 17:00:07.392223 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:07.392180 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-qwlm6_4d56f716-900e-4d90-b8af-1cb8b2e8e95d/networking-console-plugin/0.log" Jul 08 17:00:07.941951 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:07.941918 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/1.log" Jul 08 17:00:07.946370 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:07.946350 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gs2hb_5a2fd05f-50f1-4a1d-bd27-efe9892427c9/console-operator/2.log" Jul 08 17:00:08.398830 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:08.398796 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fbfc649f5-jtjrf_47287db0-a10f-4a42-a595-310323e7a5fe/console/0.log" Jul 08 17:00:09.246945 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.246917 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7"] Jul 08 17:00:09.250377 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.250356 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.252880 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.252861 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xjj5\"/\"default-dockercfg-2zhv5\"" Jul 08 17:00:09.253432 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.253417 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjj5\"/\"openshift-service-ca.crt\"" Jul 08 17:00:09.253534 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.253425 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjj5\"/\"kube-root-ca.crt\"" Jul 08 17:00:09.262660 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.262638 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7"] Jul 08 17:00:09.382759 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.382731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-proc\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.382958 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.382786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-sys\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.382958 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.382824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmvk2\" (UniqueName: \"kubernetes.io/projected/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-kube-api-access-nmvk2\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.382958 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.382854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-lib-modules\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.382958 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.382940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-podres\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484033 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.483997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-sys\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvk2\" (UniqueName: \"kubernetes.io/projected/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-kube-api-access-nmvk2\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-lib-modules\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-podres\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-proc\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484152 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-sys\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484223 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-proc\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-lib-modules\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.484460 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.484272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-podres\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.494124 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.494085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmvk2\" (UniqueName: \"kubernetes.io/projected/9f5d6a7c-eb04-444a-b5d7-14080a796ac2-kube-api-access-nmvk2\") pod \"perf-node-gather-daemonset-8psn7\" (UID: \"9f5d6a7c-eb04-444a-b5d7-14080a796ac2\") " pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.560342 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.560250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:09.688015 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:09.687985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7"] Jul 08 17:00:09.690610 ip-10-0-134-45 kubenswrapper[2577]: W0708 17:00:09.690580 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9f5d6a7c_eb04_444a_b5d7_14080a796ac2.slice/crio-c55ae2a9075b9257d7b57777e833f9d0153e64ede36d132d32aaeba9a3a20e93 WatchSource:0}: Error finding container c55ae2a9075b9257d7b57777e833f9d0153e64ede36d132d32aaeba9a3a20e93: Status 404 returned error can't find the container with id c55ae2a9075b9257d7b57777e833f9d0153e64ede36d132d32aaeba9a3a20e93 Jul 08 17:00:10.335433 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.335397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" event={"ID":"9f5d6a7c-eb04-444a-b5d7-14080a796ac2","Type":"ContainerStarted","Data":"bf541335e6d74d5dc76dbe12babc12362f968dc671a0ba57452f505fdc5fed94"} Jul 08 17:00:10.335612 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.335450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" event={"ID":"9f5d6a7c-eb04-444a-b5d7-14080a796ac2","Type":"ContainerStarted","Data":"c55ae2a9075b9257d7b57777e833f9d0153e64ede36d132d32aaeba9a3a20e93"} Jul 08 17:00:10.335612 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.335490 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:10.355819 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.355777 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" podStartSLOduration=1.355760751 podStartE2EDuration="1.355760751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:00:10.354955587 +0000 UTC m=+1553.636665658" watchObservedRunningTime="2026-07-08 17:00:10.355760751 +0000 UTC m=+1553.637470822" Jul 08 17:00:10.371225 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.371201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj766_a7a81626-2dd9-4629-b625-f9cb41340f67/dns/0.log" Jul 08 17:00:10.400148 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.400124 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tj766_a7a81626-2dd9-4629-b625-f9cb41340f67/kube-rbac-proxy/0.log" Jul 08 17:00:10.459509 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:10.459484 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j5562_d61818f9-d863-4b87-9a65-ed69ae954595/dns-node-resolver/0.log" Jul 08 17:00:11.081656 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:11.081615 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzsz5_617927bf-79d1-4421-a466-f4174ba28b6a/node-ca/0.log" Jul 08 17:00:12.505723 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:12.505671 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmgh8_2b2ada3b-fe81-49bb-9c37-60e2fd4406cb/serve-healthcheck-canary/0.log" Jul 08 17:00:13.045928 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:13.045896 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4zqn_2ff73140-abdc-441c-8b1b-537e13f6c68e/kube-rbac-proxy/0.log" Jul 08 17:00:13.068676 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:13.068649 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4zqn_2ff73140-abdc-441c-8b1b-537e13f6c68e/exporter/0.log" Jul 08 17:00:13.092236 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:13.092203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4zqn_2ff73140-abdc-441c-8b1b-537e13f6c68e/extractor/0.log" Jul 08 17:00:15.326881 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.326857 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-c8c545f5f-fpqnp_2ea8f183-ed49-4ff3-a9bb-07daf4511f4d/manager/0.log" Jul 08 17:00:15.377397 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.377373 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-r9rdg_7c38fe71-4ef0-419f-a3e0-cf9b9e13cba5/server/0.log" Jul 08 17:00:15.442931 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.442888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-6bf2z_f2a2f266-2e1d-4205-a434-7de3c2625daa/manager/0.log" Jul 08 17:00:15.640228 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.640197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-kpsj8_aa56c86a-531a-4fd8-ba2c-6a607a0d827d/seaweedfs/0.log" Jul 08 17:00:15.666805 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.666781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-wxxst_342aa2e7-8cc6-41e9-a975-7e700c1695b5/seaweedfs-tls-custom/0.log" Jul 08 17:00:15.691188 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:15.691167 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-cc8h4_9beb7995-3891-4fe9-8e89-9945a720b076/seaweedfs-tls-serving/0.log" Jul 08 17:00:16.349246 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:16.349221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xjj5/perf-node-gather-daemonset-8psn7" Jul 08 17:00:22.201461 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.201435 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/kube-multus-additional-cni-plugins/0.log" Jul 08 17:00:22.226179 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.226153 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/egress-router-binary-copy/0.log" Jul 08 17:00:22.251465 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.251437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/cni-plugins/0.log" Jul 08 17:00:22.277108 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.277090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/bond-cni-plugin/0.log" Jul 08 17:00:22.303423 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.303397 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/routeoverride-cni/0.log" Jul 08 17:00:22.328179 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.328159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/whereabouts-cni-bincopy/0.log" Jul 08 17:00:22.357118 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.357097 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8jf8m_95facfe2-602f-4673-a321-e9cbe2b6ba6d/whereabouts-cni/0.log" Jul 08 17:00:22.839583 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.839559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wnkqt_a8bb9ce6-692c-4573-a534-0d17b0f87bea/kube-multus/0.log" Jul 08 17:00:22.865097 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.865065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n8gml_b4bff7c4-503c-465b-a028-1f48a7318748/network-metrics-daemon/0.log" Jul 08 17:00:22.895430 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:22.895405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n8gml_b4bff7c4-503c-465b-a028-1f48a7318748/kube-rbac-proxy/0.log" Jul 08 17:00:24.097473 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.097431 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/ovn-controller/0.log" Jul 08 17:00:24.122016 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.121995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/ovn-acl-logging/0.log" Jul 08 17:00:24.150359 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.150333 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/kube-rbac-proxy-node/0.log" Jul 08 17:00:24.174853 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.174834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 17:00:24.199744 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.199725 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/northd/0.log" Jul 08 17:00:24.225890 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.225865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/nbdb/0.log" Jul 08 17:00:24.251665 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.251634 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/sbdb/0.log" Jul 08 17:00:24.293038 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:24.293013 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lthzr_2418860c-84f5-443c-aac8-cee1470fe314/ovnkube-controller/0.log" Jul 08 17:00:25.698317 ip-10-0-134-45 kubenswrapper[2577]: I0708 17:00:25.698287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5c5x4_c907588d-0c5d-452e-92b6-a89b25ea9fb5/network-check-target-container/0.log"