Jul 01 19:20:39.662844 ip-10-0-134-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 19:20:39.662859 ip-10-0-134-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 19:20:39.662868 ip-10-0-134-25 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 19:20:39.663178 ip-10-0-134-25 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 19:20:49.753051 ip-10-0-134-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 19:20:49.753071 ip-10-0-134-25 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fff91c6caef947e48eedfc3fe2ab02a5 -- Jul 01 19:22:55.736185 ip-10-0-134-25 systemd[1]: Starting Kubernetes Kubelet... Jul 01 19:22:56.133397 ip-10-0-134-25 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:56.133397 ip-10-0-134-25 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 19:22:56.133397 ip-10-0-134-25 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:56.133397 ip-10-0-134-25 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 19:22:56.133397 ip-10-0-134-25 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 19:22:56.134127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.133416 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 19:22:56.137853 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137836 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.137853 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137854 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137858 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137862 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137865 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137867 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137870 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137885 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137888 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137891 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137894 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137896 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137899 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137901 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137904 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137906 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137909 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137911 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137914 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137917 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137919 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.137938 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137922 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137924 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137927 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137929 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137932 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137934 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137937 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137940 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137943 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137945 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137948 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137951 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137955 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137959 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137962 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137965 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137968 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137971 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137974 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.138406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137976 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137979 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137981 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137986 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137989 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137991 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137994 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137997 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.137999 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138002 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138004 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138007 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138009 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138012 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138015 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138018 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138022 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138024 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138027 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.138945 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138031 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138034 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138036 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138039 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138041 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138043 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138046 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138048 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138051 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138053 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138055 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138058 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138060 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138063 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138065 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138068 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138070 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138073 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138075 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138078 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.139411 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138080 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138085 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138087 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138089 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138092 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138094 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138097 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138100 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138102 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138106 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138109 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138111 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138113 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138116 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138118 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138121 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138124 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138126 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138129 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.139906 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138815 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138822 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138827 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138830 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138844 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138847 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138850 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138852 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138855 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138857 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138860 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138863 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138865 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138867 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138871 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138888 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138891 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138893 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138897 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.140393 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138899 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138902 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138905 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138907 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138910 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138912 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138915 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138917 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138919 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138922 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138925 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138927 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138929 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138934 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138937 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138940 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138943 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138945 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138948 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138951 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.140926 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138953 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138956 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138959 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138962 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138965 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138968 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138970 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138973 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138975 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138978 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138980 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138983 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138986 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138988 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138991 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138993 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138996 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.138998 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139001 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.141413 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139003 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139006 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139009 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139011 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139014 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139016 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139019 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139021 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139023 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139026 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139028 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139030 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139034 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139037 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139042 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139045 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139048 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139050 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139052 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.141892 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139055 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139057 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139060 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139062 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139064 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139067 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139070 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139073 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139076 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139078 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139081 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139085 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139088 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139091 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139093 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139096 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139099 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139101 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139104 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139106 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.142380 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139109 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139497 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139502 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139506 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139510 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139513 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139515 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139520 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139523 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139525 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139528 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139531 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139533 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139536 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139538 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139541 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139545 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139548 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139552 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.142898 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139556 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139559 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139562 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139565 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139568 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139570 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139573 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139575 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139577 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139580 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139583 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139585 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139587 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139590 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139592 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139595 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139597 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139600 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139603 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.143372 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139607 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139612 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139614 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139617 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139620 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139623 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139625 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139628 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139630 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139633 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139635 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139640 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139642 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139645 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139647 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139650 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139652 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139655 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139657 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139659 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.143822 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139662 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139665 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139667 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139670 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139672 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139674 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139677 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139680 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139683 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139685 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139688 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139690 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139692 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139696 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139699 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139701 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139704 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139706 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139709 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.144323 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139711 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139714 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139716 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139718 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139722 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139725 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139727 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139730 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139732 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139735 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139737 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139739 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139742 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139745 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139747 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139750 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139752 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139754 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139757 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139759 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.144783 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139761 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139764 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.139766 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139836 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139847 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139853 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139859 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139864 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139867 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139871 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139889 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139892 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139895 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139899 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139902 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139905 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139909 2563 flags.go:64] FLAG: --cgroup-root="" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139912 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139915 2563 flags.go:64] FLAG: --client-ca-file="" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139918 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139921 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139925 2563 flags.go:64] FLAG: --cluster-domain="" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139927 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139930 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 19:22:56.145291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139933 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139936 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139940 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139943 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139946 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139949 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139952 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139954 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139957 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139960 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139963 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139967 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139970 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139972 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139976 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139979 2563 flags.go:64] FLAG: --enable-server="true" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139983 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139988 2563 flags.go:64] FLAG: --event-burst="100" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139991 2563 flags.go:64] FLAG: --event-qps="50" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139994 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139997 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.139999 2563 flags.go:64] FLAG: --eviction-hard="" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140003 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140006 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140009 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 19:22:56.145927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140012 2563 flags.go:64] FLAG: --eviction-soft="" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140015 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140017 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140020 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140023 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140025 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140028 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140030 2563 flags.go:64] FLAG: --feature-gates="" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140034 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140036 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140039 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140042 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140045 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140048 2563 flags.go:64] FLAG: --help="false" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140050 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140053 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140056 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140059 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140062 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140065 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140068 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140072 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140075 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 19:22:56.146565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140078 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140081 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140084 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140087 2563 flags.go:64] FLAG: --kube-reserved="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140089 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140092 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140095 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140098 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140101 2563 flags.go:64] FLAG: --lock-file="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140104 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140106 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140109 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140114 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140117 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140120 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140123 2563 flags.go:64] FLAG: --logging-format="text" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140125 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140128 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140131 2563 flags.go:64] FLAG: --manifest-url="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140134 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140138 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140141 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140145 2563 flags.go:64] FLAG: --max-pods="110" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140147 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140150 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 19:22:56.147223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140153 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140155 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140158 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140161 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140163 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140174 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140177 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140179 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140182 2563 flags.go:64] FLAG: --pod-cidr="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140185 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140190 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140193 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140196 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140199 2563 flags.go:64] FLAG: --port="10250" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140202 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140205 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7b6ce74bd2008c0" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140208 2563 flags.go:64] FLAG: --qos-reserved="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140211 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140214 2563 flags.go:64] FLAG: --register-node="true" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140216 2563 flags.go:64] FLAG: --register-with-taints="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140220 2563 flags.go:64] FLAG: --registry-burst="10" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140223 2563 flags.go:64] FLAG: --registry-qps="5" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140226 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140228 2563 flags.go:64] FLAG: --reserved-memory="" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140232 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 19:22:56.147831 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140235 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140238 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140241 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140243 2563 flags.go:64] FLAG: --runonce="false" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140246 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140249 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140251 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140254 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140257 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140260 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140262 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140265 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140269 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140272 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140275 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140277 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140280 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140283 2563 flags.go:64] FLAG: --system-cgroups="" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140286 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140291 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140294 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140296 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140300 2563 flags.go:64] FLAG: --tls-min-version="" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140303 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140306 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 19:22:56.148454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140308 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140311 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140314 2563 flags.go:64] FLAG: --v="2" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140317 2563 flags.go:64] FLAG: --version="false" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140321 2563 flags.go:64] FLAG: --vmodule="" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140324 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.140327 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140441 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140445 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140448 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140450 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140453 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140456 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140458 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140461 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140463 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140465 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140468 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140470 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140473 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140475 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.149096 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140478 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140480 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140482 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140485 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140488 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140490 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140492 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140495 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140497 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140501 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140504 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140506 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140510 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140514 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140516 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140519 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140521 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140524 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140526 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.149634 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140529 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140532 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140536 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140539 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140542 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140546 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140549 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140552 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140554 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140557 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140560 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140562 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140565 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140567 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140569 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140572 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140575 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140577 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140580 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.150128 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140582 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140585 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140587 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140593 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140595 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140598 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140600 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140603 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140605 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140608 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140610 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140612 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140615 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140617 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140620 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140623 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140625 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140627 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140630 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140632 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.150581 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140635 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140637 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140640 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140642 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140645 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140647 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140649 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140652 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140654 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140657 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140659 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140662 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140665 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140667 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140669 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140673 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140675 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140678 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140680 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.151207 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140683 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140685 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140688 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140690 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140692 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140695 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140697 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.140700 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.141379 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148122 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148137 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148157 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148162 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148215 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148220 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.151842 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148224 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148228 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148232 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148236 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148239 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148241 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148244 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148246 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148249 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148252 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148256 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148258 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148261 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148264 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148266 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148269 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148271 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148275 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148277 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.152304 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148280 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148283 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148285 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148287 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148290 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148293 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148295 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148298 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148301 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148304 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148307 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148309 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148312 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148314 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148317 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148319 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148322 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148324 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148326 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148329 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.152769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148332 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148334 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148337 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148340 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148343 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148345 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148348 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148350 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148353 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148355 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148358 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148361 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148363 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148367 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148371 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148374 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148377 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148379 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148382 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.153294 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148385 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148388 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148391 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148393 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148396 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148398 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148400 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148403 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148406 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148409 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148413 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148415 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148418 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148420 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148423 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148425 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148428 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148431 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148433 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.153771 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148436 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148438 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148440 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148443 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148446 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148448 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148451 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148453 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148456 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148458 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148461 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148464 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148466 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148469 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148472 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148474 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148478 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148480 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148483 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.154261 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148485 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148490 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148606 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148610 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148613 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148616 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148618 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148621 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148623 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148626 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148628 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148631 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148633 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148636 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 19:22:56.154748 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148639 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148641 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148644 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148646 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148649 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148651 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148654 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148656 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148658 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148661 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148664 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148666 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148670 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148674 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148677 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148679 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148682 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148684 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148686 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148689 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 19:22:56.155193 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148691 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148694 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148696 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148698 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148701 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148703 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148706 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148708 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148710 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148713 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148716 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148718 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148721 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148723 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148726 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148728 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148731 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148733 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148735 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148738 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 19:22:56.155769 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148740 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148743 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148745 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148747 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148750 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148752 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148755 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148757 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148760 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148762 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148764 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148767 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148769 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148772 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148774 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148777 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148779 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148782 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148784 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148787 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 19:22:56.156263 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148789 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148793 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148796 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148799 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148802 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148805 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148807 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148810 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148813 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148815 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148818 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148821 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148823 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148826 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148828 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148831 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148833 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148836 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148839 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 19:22:56.156772 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148842 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148845 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148848 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148851 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148853 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148856 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148858 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:56.148861 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148865 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.148975 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.152926 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.154595 2563 server.go:1019] "Starting client certificate rotation" Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.154705 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:56.157264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.155481 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 19:22:56.157586 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.157220 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:56.158392 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.158360 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 19:22:56.168127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.168113 2563 log.go:25] "Validated CRI v1 runtime API" Jul 01 19:22:56.172057 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.172037 2563 log.go:25] "Validated CRI v1 image API" Jul 01 19:22:56.172943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.172924 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 19:22:56.177277 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.177249 2563 fs.go:135] Filesystem UUIDs: map[2f15c2de-c159-4641-92fe-673f287c1831:/dev/nvme0n1p3 4bcb39e3-2928-45db-a7a5-cfb02703abd2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 01 19:22:56.177339 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.177278 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 19:22:56.182087 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.181977 2563 manager.go:216] Machine: {Timestamp:2026-07-01 19:22:56.18091691 +0000 UTC m=+0.326890642 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100091 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec205fe67a51526349698907f74df90c SystemUUID:ec205fe6-7a51-5263-4969-8907f74df90c BootID:fff91c6c-aef9-47e4-8eed-fc3fe2ab02a5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:5a:ed:48:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:5a:ed:48:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:d0:37:f3:0a:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 19:22:56.182087 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.182079 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 19:22:56.182207 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.182159 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 19:22:56.185389 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.185359 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 19:22:56.185530 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.185392 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 19:22:56.186202 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.186192 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 19:22:56.186236 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.186204 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 19:22:56.186236 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.186212 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:56.186845 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.186828 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 19:22:56.187687 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.187677 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 19:22:56.187687 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.187680 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:56.190989 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.190976 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:56.191127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191117 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 19:22:56.191158 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191148 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 01 19:22:56.191185 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191158 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 19:22:56.191185 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191175 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 19:22:56.191185 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191185 2563 kubelet.go:398] "Adding apiserver pod source" Jul 01 19:22:56.191279 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191194 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 19:22:56.191543 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191532 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:56.191586 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.191551 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 19:22:56.195360 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.195341 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 19:22:56.196793 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.196778 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 19:22:56.196860 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.196809 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 19:22:56.197521 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197510 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 19:22:56.197557 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197526 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 19:22:56.197557 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197540 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 19:22:56.197557 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197550 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197562 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197568 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197576 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197582 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197589 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197594 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197602 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 19:22:56.197641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.197608 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 19:22:56.198556 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.198547 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 19:22:56.198604 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.198557 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 19:22:56.202259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.202138 2563 server.go:1268] "Started kubelet" Jul 01 19:22:56.202259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.202220 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 19:22:56.202400 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.202239 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 19:22:56.202400 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.202297 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 19:22:56.202742 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.202671 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 19:22:56.202742 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.202738 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 19:22:56.203035 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.203007 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 19:22:56.203131 ip-10-0-134-25 systemd[1]: Started Kubernetes Kubelet. Jul 01 19:22:56.203756 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.203728 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 19:22:56.204732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.204719 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 01 19:22:56.207706 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.207684 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 19:22:56.207778 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.206986 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-25.ec2.internal.18be40d2b4929ab1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-25.ec2.internal,UID:ip-10-0-134-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-25.ec2.internal,},FirstTimestamp:2026-07-01 19:22:56.202111665 +0000 UTC m=+0.348085396,LastTimestamp:2026-07-01 19:22:56.202111665 +0000 UTC m=+0.348085396,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-25.ec2.internal,}" Jul 01 19:22:56.210179 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210161 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 19:22:56.210261 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210181 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:56.210261 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.210224 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.210852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210827 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 19:22:56.210852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210853 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 19:22:56.211004 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210947 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 01 19:22:56.211004 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210958 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 01 19:22:56.211004 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.210982 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 19:22:56.211115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211019 2563 factory.go:55] Registering systemd factory Jul 01 19:22:56.211115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211035 2563 factory.go:223] Registration of the systemd container factory successfully Jul 01 19:22:56.211314 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211298 2563 factory.go:153] Registering CRI-O factory Jul 01 19:22:56.211314 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211317 2563 factory.go:223] Registration of the crio container factory successfully Jul 01 19:22:56.211443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211363 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 19:22:56.211443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211386 2563 factory.go:103] Registering Raw factory Jul 01 19:22:56.211443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.211398 2563 manager.go:1196] Started watching for new ooms in manager Jul 01 19:22:56.212409 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.212395 2563 manager.go:349] Starting recovery of all containers Jul 01 19:22:56.216505 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.214056 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77545" Jul 01 19:22:56.221297 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.220889 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 19:22:56.221297 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.221240 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 19:22:56.222094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.222044 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-77545" Jul 01 19:22:56.224206 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.224189 2563 manager.go:354] Recovery completed Jul 01 19:22:56.225727 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.225711 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 01 19:22:56.228714 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.228702 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.230696 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.230678 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.230777 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.230711 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.230777 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.230723 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.231378 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.231362 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 19:22:56.231378 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.231378 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 19:22:56.231501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.231385 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.231501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.231396 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 01 19:22:56.232130 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232114 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.232212 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232145 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.232212 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232159 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.232580 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232566 2563 policy_none.go:49] "None policy: Start" Jul 01 19:22:56.232625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232587 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 19:22:56.232625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.232601 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 19:22:56.233941 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.233931 2563 policy_none.go:47] "Start" Jul 01 19:22:56.268548 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.268531 2563 manager.go:337] "Starting Device Plugin manager" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.268576 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.268590 2563 server.go:87] "Starting device plugin registration server" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.268855 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.268867 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.268978 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.269061 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.269068 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.269683 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.269736 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.283044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.281783 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 19:22:56.283489 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.283051 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 19:22:56.283489 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.283097 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 19:22:56.283489 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.283124 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 19:22:56.283489 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.283161 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 19:22:56.285758 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.285739 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:56.369945 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.369895 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.371543 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.371527 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.371627 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.371559 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.371627 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.371571 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.371627 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.371607 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.383282 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.383261 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal"] Jul 01 19:22:56.383330 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.383324 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.385074 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.385028 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.385074 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.385058 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.385074 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.385068 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.386355 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.386343 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.386494 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.386480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.386538 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.386510 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.387084 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387066 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.387173 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387093 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.387173 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387106 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.387277 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387104 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.387277 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387202 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.387277 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.387211 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.388351 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.388334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.388410 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.388372 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 19:22:56.388616 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.388604 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.388651 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.388624 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-25.ec2.internal\": node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.389062 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.389049 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 19:22:56.389115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.389071 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 19:22:56.389115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.389094 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 19:22:56.419555 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.419535 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-25.ec2.internal\" not found" node="ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.423978 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.423965 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-25.ec2.internal\" not found" node="ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.441914 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.441894 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.512434 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.512408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15f196c730bb2d51f2a3cacfe68d0520-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"15f196c730bb2d51f2a3cacfe68d0520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.512553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.512434 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.512553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.512480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.542793 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.542771 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.612793 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15f196c730bb2d51f2a3cacfe68d0520-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"15f196c730bb2d51f2a3cacfe68d0520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.612793 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.613011 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.613011 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.613011 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15f196c730bb2d51f2a3cacfe68d0520-config\") pod \"kube-apiserver-proxy-ip-10-0-134-25.ec2.internal\" (UID: \"15f196c730bb2d51f2a3cacfe68d0520\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.613011 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.612941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354079333571f1bca510c91f3f489015-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal\" (UID: \"354079333571f1bca510c91f3f489015\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.643351 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.643292 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.723371 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.723330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.727636 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:56.727533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:56.744042 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.744018 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.844544 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.844506 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:56.945115 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:56.945040 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:57.047686 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:57.047654 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:57.148931 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:57.148898 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:57.153344 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.153325 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 19:22:57.153519 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.153499 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 19:22:57.227216 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.227128 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 19:17:56 +0000 UTC" deadline="2028-01-26 08:23:24.733615771 +0000 UTC" Jul 01 19:22:57.227216 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.227159 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13765h0m27.506460804s" Jul 01 19:22:57.237471 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.237448 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:57.249267 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:57.249241 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-25.ec2.internal\" not found" Jul 01 19:22:57.253394 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.253378 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:57.311397 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.311368 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" Jul 01 19:22:57.332660 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.332602 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:57.333819 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.333800 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" Jul 01 19:22:57.349553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.349532 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 19:22:57.409807 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:57.409755 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f196c730bb2d51f2a3cacfe68d0520.slice/crio-6c97f3bde27ae88851b55aefc80e135f755c1ef1a26283f8e9400c2bdd32ca3e WatchSource:0}: Error finding container 6c97f3bde27ae88851b55aefc80e135f755c1ef1a26283f8e9400c2bdd32ca3e: Status 404 returned error can't find the container with id 6c97f3bde27ae88851b55aefc80e135f755c1ef1a26283f8e9400c2bdd32ca3e Jul 01 19:22:57.410150 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:57.410126 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354079333571f1bca510c91f3f489015.slice/crio-0ff1c333f17cdb7120b3b1c5a940a4ff74252ad38ab004c548fddf64f58f568e WatchSource:0}: Error finding container 0ff1c333f17cdb7120b3b1c5a940a4ff74252ad38ab004c548fddf64f58f568e: Status 404 returned error can't find the container with id 0ff1c333f17cdb7120b3b1c5a940a4ff74252ad38ab004c548fddf64f58f568e Jul 01 19:22:57.415776 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.415759 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:22:57.499045 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:57.498979 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:58.192789 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.192755 2563 apiserver.go:52] "Watching apiserver" Jul 01 19:22:58.201911 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.201881 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 19:22:58.207170 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.206655 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 19:22:58.209533 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.209500 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-xswkr","openshift-ovn-kubernetes/ovnkube-node-dd4gr","kube-system/global-pull-secret-syncer-lcpjl","kube-system/konnectivity-agent-wk8b7","kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr","openshift-cluster-node-tuning-operator/tuned-8rfrv","openshift-image-registry/node-ca-fd8f2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal","openshift-multus/network-metrics-daemon-bt4tw","openshift-dns/node-resolver-qxzvw","openshift-multus/multus-additional-cni-plugins-hvt5n","openshift-multus/multus-ggsps","openshift-network-diagnostics/network-check-target-gczjd"] Jul 01 19:22:58.211008 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.210985 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 19:22:58.211471 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.211453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.212618 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.212477 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.213761 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.213741 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.213858 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.213824 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:22:58.215282 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.215262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.216049 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.215999 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.216146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216095 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.216250 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216212 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.216445 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216429 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4svtt\"" Jul 01 19:22:58.216745 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216726 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2kkkd\"" Jul 01 19:22:58.216929 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216901 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.217035 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.216985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:22:58.217228 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.217142 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:22:58.217612 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.217569 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 19:22:58.218218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.218199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.219527 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.219321 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wsv4j\"" Jul 01 19:22:58.219625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.219559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 19:22:58.219748 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.219728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.221085 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.221186 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221144 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mdbs7\"" Jul 01 19:22:58.221357 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221338 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-kubernetes\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221432 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-conf\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221432 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-lib-modules\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221432 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-modprobe-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221473 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-tuned\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-tmp-dir\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221518 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-sys\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-hosts-file\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-systemd\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-run\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-var-lib-kubelet\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-tmp\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/fcd77b49-99c9-47de-8df3-5cf1da63909d-kube-api-access-bhfp5\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wch\" (UniqueName: \"kubernetes.io/projected/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-kube-api-access-l8wch\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221752 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-host\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.221943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.221782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysconfig\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.222418 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.222347 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 19:22:58.222596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.222577 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.222815 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.222795 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.223102 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.223084 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.223354 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.223333 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pf5f9\"" Jul 01 19:22:58.223537 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.223518 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 19:22:58.223914 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.223738 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.225253 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.224087 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.225253 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.224351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.225253 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.224419 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:22:58.225253 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.225103 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 19:22:58.228524 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.228488 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.230200 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.230178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.231026 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.230990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.231117 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.231032 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pfddm\"" Jul 01 19:22:58.235155 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.235134 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 19:22:58.235610 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.235591 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 19:22:58.235993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.235963 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 19:22:58.236155 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.236110 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 19:22:58.236726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.236348 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 19:22:58.236726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.236377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.236726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.236665 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.238166 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.238144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 19:22:58.239762 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.239567 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.240213 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.239923 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 19:22:58.240213 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.240117 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xqnst\"" Jul 01 19:22:58.243070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.242509 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qv8kr\"" Jul 01 19:22:58.243070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.242847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:22:58.243422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.243394 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ck9fk\"" Jul 01 19:22:58.243487 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.243429 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 19:22:58.243864 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.243761 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 19:22:58.245625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.245229 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 19:22:58.262050 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.261902 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5pkn6" Jul 01 19:22:58.270670 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.270308 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5pkn6" Jul 01 19:22:58.291771 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.291649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" event={"ID":"15f196c730bb2d51f2a3cacfe68d0520","Type":"ContainerStarted","Data":"6c97f3bde27ae88851b55aefc80e135f755c1ef1a26283f8e9400c2bdd32ca3e"} Jul 01 19:22:58.293192 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.293047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"354079333571f1bca510c91f3f489015","Type":"ContainerStarted","Data":"0ff1c333f17cdb7120b3b1c5a940a4ff74252ad38ab004c548fddf64f58f568e"} Jul 01 19:22:58.312437 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.312419 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322450 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-socket-dir-parent\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-multus-certs\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-config\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09395a8c-6f48-4cd2-9e54-fa9badae427b-iptables-alerter-script\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.322574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-var-lib-kubelet\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-tmp\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-host\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-var-lib-kubelet\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysconfig\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-kubernetes\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-kubelet\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322762 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysconfig\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322802 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-host\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-kubernetes\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-modprobe-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-os-release\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322933 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-etc-kubernetes\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.322996 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-hosts-file\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.322915 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323019 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-bin\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-modprobe-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323184 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-hosts-file\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf98f927-aeec-411e-8453-48e276a013b0-serviceca\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wch\" (UniqueName: \"kubernetes.io/projected/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-kube-api-access-l8wch\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-system-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-conf-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-netns\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323346 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-etc-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsg25\" (UniqueName: \"kubernetes.io/projected/2dfd2119-0194-4538-baca-4512b4dc4e76-kube-api-access-rsg25\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-script-lib\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323476 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-conf\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-daemon-config\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-tuned\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.323851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323578 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-netns\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323625 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-bin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323632 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-conf\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-hostroot\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-slash\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99njm\" (UniqueName: \"kubernetes.io/projected/c3327b66-7666-4066-9d83-8af7c759a53f-kube-api-access-99njm\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-sys\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-multus\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323866 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9c49\" (UniqueName: \"kubernetes.io/projected/6e7caaa8-3887-4146-b2a8-f61eb06c6351-kube-api-access-t9c49\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-systemd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-env-overrides\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.323989 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09395a8c-6f48-4cd2-9e54-fa9badae427b-host-slash\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-sys\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf98f927-aeec-411e-8453-48e276a013b0-host\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324068 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.325094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-run\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/fcd77b49-99c9-47de-8df3-5cf1da63909d-kube-api-access-bhfp5\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324177 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-run\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-systemd-units\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dfd2119-0194-4538-baca-4512b4dc4e76-ovn-node-metrics-cert\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-agent-certs\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-konnectivity-ca\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j25db\" (UniqueName: \"kubernetes.io/projected/d4747c29-a163-4616-9373-f0e6545d3f6b-kube-api-access-j25db\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nc2w\" (UniqueName: \"kubernetes.io/projected/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kube-api-access-5nc2w\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cnibin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-k8s-cni-cncf-io\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-socket-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-sys-fs\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-kubelet\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-node-log\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.326015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-os-release\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-dbus\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-registration-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-device-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-systemd\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cni-binary-copy\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg67b\" (UniqueName: \"kubernetes.io/projected/09395a8c-6f48-4cd2-9e54-fa9badae427b-kube-api-access-sg67b\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9f2t\" (UniqueName: \"kubernetes.io/projected/cf98f927-aeec-411e-8453-48e276a013b0-kube-api-access-h9f2t\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.324987 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-system-cni-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-cnibin\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-kubelet-config\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-var-lib-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-ovn\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-sysctl-d\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.326881 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-log-socket\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325249 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-tmp-dir\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-systemd\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-lib-modules\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-tmp-dir\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-netd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.325883 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcd77b49-99c9-47de-8df3-5cf1da63909d-lib-modules\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.328146 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.327591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-tmp\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.329910 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.329884 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fcd77b49-99c9-47de-8df3-5cf1da63909d-etc-tuned\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.334802 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.334758 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wch\" (UniqueName: \"kubernetes.io/projected/ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad-kube-api-access-l8wch\") pod \"node-resolver-qxzvw\" (UID: \"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad\") " pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.335295 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.335267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/fcd77b49-99c9-47de-8df3-5cf1da63909d-kube-api-access-bhfp5\") pod \"tuned-8rfrv\" (UID: \"fcd77b49-99c9-47de-8df3-5cf1da63909d\") " pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.426895 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-kubelet\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-os-release\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-etc-kubernetes\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-kubelet\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.426999 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.427072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-os-release\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427066 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-etc-kubernetes\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-bin\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf98f927-aeec-411e-8453-48e276a013b0-serviceca\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-system-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-conf-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-bin\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-netns\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-etc-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427335 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-conf-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427348 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-netns\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-etc-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsg25\" (UniqueName: \"kubernetes.io/projected/2dfd2119-0194-4538-baca-4512b4dc4e76-kube-api-access-rsg25\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.427393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-system-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-script-lib\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427473 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-daemon-config\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-netns\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-bin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-hostroot\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-hostroot\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-slash\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99njm\" (UniqueName: \"kubernetes.io/projected/c3327b66-7666-4066-9d83-8af7c759a53f-kube-api-access-99njm\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427704 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf98f927-aeec-411e-8453-48e276a013b0-serviceca\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-netns\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-bin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428070 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-multus\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427755 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-slash\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427753 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9c49\" (UniqueName: \"kubernetes.io/projected/6e7caaa8-3887-4146-b2a8-f61eb06c6351-kube-api-access-t9c49\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-systemd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427814 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-env-overrides\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09395a8c-6f48-4cd2-9e54-fa9badae427b-host-slash\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf98f927-aeec-411e-8453-48e276a013b0-host\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-run-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-cni-multus\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428150 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-daemon-config\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf98f927-aeec-411e-8453-48e276a013b0-host\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09395a8c-6f48-4cd2-9e54-fa9badae427b-host-slash\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428290 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-systemd-units\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-systemd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428329 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-script-lib\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.427913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-systemd-units\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.428908 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.428397 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428439 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dfd2119-0194-4538-baca-4512b4dc4e76-ovn-node-metrics-cert\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-env-overrides\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.428506 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:58.928482045 +0000 UTC m=+3.074455769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-agent-certs\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-konnectivity-ca\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j25db\" (UniqueName: \"kubernetes.io/projected/d4747c29-a163-4616-9373-f0e6545d3f6b-kube-api-access-j25db\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nc2w\" (UniqueName: \"kubernetes.io/projected/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kube-api-access-5nc2w\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428918 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cnibin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-k8s-cni-cncf-io\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.428973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-socket-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-sys-fs\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-kubelet\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429034 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cnibin\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-node-log\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429103 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.429852 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-os-release\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-dbus\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429157 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-socket-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-node-log\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-var-lib-kubelet\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-sys-fs\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429216 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-konnectivity-ca\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-os-release\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-registration-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429272 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-registration-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-device-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429273 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-k8s-cni-cncf-io\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-device-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429309 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-dbus\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cni-binary-copy\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429475 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg67b\" (UniqueName: \"kubernetes.io/projected/09395a8c-6f48-4cd2-9e54-fa9badae427b-kube-api-access-sg67b\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9f2t\" (UniqueName: \"kubernetes.io/projected/cf98f927-aeec-411e-8453-48e276a013b0-kube-api-access-h9f2t\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.429314 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:58.430690 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-system-cni-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429575 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-cnibin\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-kubelet-config\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.429631 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:22:58.929602278 +0000 UTC m=+3.075576018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-kubelet-config\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e7caaa8-3887-4146-b2a8-f61eb06c6351-cni-binary-copy\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-system-cni-dir\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429846 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4747c29-a163-4616-9373-f0e6545d3f6b-cnibin\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-var-lib-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429928 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-ovn\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429955 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-log-socket\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-var-lib-openvswitch\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.429986 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-netd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430046 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-cni-dir\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430065 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-run-ovn\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-log-socket\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430114 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430134 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2dfd2119-0194-4538-baca-4512b4dc4e76-host-cni-netd\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-socket-dir-parent\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-multus-certs\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-multus-socket-dir-parent\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-config\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430207 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e7caaa8-3887-4146-b2a8-f61eb06c6351-host-run-multus-certs\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09395a8c-6f48-4cd2-9e54-fa9badae427b-iptables-alerter-script\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2dfd2119-0194-4538-baca-4512b4dc4e76-ovnkube-config\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.431991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/09395a8c-6f48-4cd2-9e54-fa9badae427b-iptables-alerter-script\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.432485 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.430896 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d4747c29-a163-4616-9373-f0e6545d3f6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.432485 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.431310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0ce27da5-348e-495a-b1dd-cc7ebb70ac9a-agent-certs\") pod \"konnectivity-agent-wk8b7\" (UID: \"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a\") " pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.432485 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.431347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dfd2119-0194-4538-baca-4512b4dc4e76-ovn-node-metrics-cert\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.457565 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.457543 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:58.457565 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.457569 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:58.457749 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.457593 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:58.457749 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.457656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:58.957637084 +0000 UTC m=+3.103610834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:58.460227 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.460198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9c49\" (UniqueName: \"kubernetes.io/projected/6e7caaa8-3887-4146-b2a8-f61eb06c6351-kube-api-access-t9c49\") pod \"multus-ggsps\" (UID: \"6e7caaa8-3887-4146-b2a8-f61eb06c6351\") " pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.460330 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.460250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nc2w\" (UniqueName: \"kubernetes.io/projected/5296786a-f02a-46b0-9f7c-b78bb738d9b0-kube-api-access-5nc2w\") pod \"aws-ebs-csi-driver-node-f4rkr\" (UID: \"5296786a-f02a-46b0-9f7c-b78bb738d9b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.460494 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.460468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99njm\" (UniqueName: \"kubernetes.io/projected/c3327b66-7666-4066-9d83-8af7c759a53f-kube-api-access-99njm\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.462895 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.462765 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j25db\" (UniqueName: \"kubernetes.io/projected/d4747c29-a163-4616-9373-f0e6545d3f6b-kube-api-access-j25db\") pod \"multus-additional-cni-plugins-hvt5n\" (UID: \"d4747c29-a163-4616-9373-f0e6545d3f6b\") " pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.462895 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.462773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg67b\" (UniqueName: \"kubernetes.io/projected/09395a8c-6f48-4cd2-9e54-fa9badae427b-kube-api-access-sg67b\") pod \"iptables-alerter-xswkr\" (UID: \"09395a8c-6f48-4cd2-9e54-fa9badae427b\") " pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.464645 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.464624 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsg25\" (UniqueName: \"kubernetes.io/projected/2dfd2119-0194-4538-baca-4512b4dc4e76-kube-api-access-rsg25\") pod \"ovnkube-node-dd4gr\" (UID: \"2dfd2119-0194-4538-baca-4512b4dc4e76\") " pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.466040 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.466010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9f2t\" (UniqueName: \"kubernetes.io/projected/cf98f927-aeec-411e-8453-48e276a013b0-kube-api-access-h9f2t\") pod \"node-ca-fd8f2\" (UID: \"cf98f927-aeec-411e-8453-48e276a013b0\") " pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.529508 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.529476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" Jul 01 19:22:58.536771 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.536746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxzvw" Jul 01 19:22:58.546648 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.546623 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:22:58.551594 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.551570 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" Jul 01 19:22:58.567234 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.567208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fd8f2" Jul 01 19:22:58.577344 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.577323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ggsps" Jul 01 19:22:58.590448 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.590429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:22:58.600466 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.600444 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xswkr" Jul 01 19:22:58.608368 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.608342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" Jul 01 19:22:58.934635 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.934527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:58.934635 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:58.934587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:22:58.934840 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.934707 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:58.934840 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.934708 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:58.934840 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.934789 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:22:59.934766048 +0000 UTC m=+4.080739770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:58.934840 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:58.934810 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:22:59.934800003 +0000 UTC m=+4.080773729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:59.035669 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:59.035627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:22:59.035891 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.035848 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:22:59.036010 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.035900 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:22:59.036010 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.035916 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:59.036010 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.035989 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:00.035968996 +0000 UTC m=+4.181942727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:22:59.272729 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:59.272685 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:58 +0000 UTC" deadline="2028-04-04 14:25:35.738269402 +0000 UTC" Jul 01 19:22:59.272729 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:59.272737 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15427h2m36.465552363s" Jul 01 19:22:59.467913 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.467858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7caaa8_3887_4146_b2a8_f61eb06c6351.slice/crio-41da13a7203b0b637773dbc1e7a3eb054fee138a788410c053dc70c04bc1a4d0 WatchSource:0}: Error finding container 41da13a7203b0b637773dbc1e7a3eb054fee138a788410c053dc70c04bc1a4d0: Status 404 returned error can't find the container with id 41da13a7203b0b637773dbc1e7a3eb054fee138a788410c053dc70c04bc1a4d0 Jul 01 19:22:59.472203 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.472178 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce2fa894_79d5_4a6c_bfda_29dbb9b3f6ad.slice/crio-22857e71b3a8df832b26a48f13681000722a1bd4ec4c32e8b11e1cc76931b0ac WatchSource:0}: Error finding container 22857e71b3a8df832b26a48f13681000722a1bd4ec4c32e8b11e1cc76931b0ac: Status 404 returned error can't find the container with id 22857e71b3a8df832b26a48f13681000722a1bd4ec4c32e8b11e1cc76931b0ac Jul 01 19:22:59.481327 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.481295 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4747c29_a163_4616_9373_f0e6545d3f6b.slice/crio-5013969a976aad78eccef2a15397a169ce764ae86dd4785d6e39d4ebe2a4cdea WatchSource:0}: Error finding container 5013969a976aad78eccef2a15397a169ce764ae86dd4785d6e39d4ebe2a4cdea: Status 404 returned error can't find the container with id 5013969a976aad78eccef2a15397a169ce764ae86dd4785d6e39d4ebe2a4cdea Jul 01 19:22:59.482225 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.482199 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd77b49_99c9_47de_8df3_5cf1da63909d.slice/crio-ebc5e4d76ba6df17e56da0bc7b1d4a2f92a51e558f82265e2f58e1a119a09fd3 WatchSource:0}: Error finding container ebc5e4d76ba6df17e56da0bc7b1d4a2f92a51e558f82265e2f58e1a119a09fd3: Status 404 returned error can't find the container with id ebc5e4d76ba6df17e56da0bc7b1d4a2f92a51e558f82265e2f58e1a119a09fd3 Jul 01 19:22:59.483194 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.483169 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5296786a_f02a_46b0_9f7c_b78bb738d9b0.slice/crio-7b06d4109e3952127487cb0dd6f55980ade74a4759c9cb8d169febdc1edd9225 WatchSource:0}: Error finding container 7b06d4109e3952127487cb0dd6f55980ade74a4759c9cb8d169febdc1edd9225: Status 404 returned error can't find the container with id 7b06d4109e3952127487cb0dd6f55980ade74a4759c9cb8d169febdc1edd9225 Jul 01 19:22:59.485250 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.485035 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09395a8c_6f48_4cd2_9e54_fa9badae427b.slice/crio-0c0cf378851112141c0a551edae4e96cff0bae91ee86b53ce399a2f5d341872d WatchSource:0}: Error finding container 0c0cf378851112141c0a551edae4e96cff0bae91ee86b53ce399a2f5d341872d: Status 404 returned error can't find the container with id 0c0cf378851112141c0a551edae4e96cff0bae91ee86b53ce399a2f5d341872d Jul 01 19:22:59.485724 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.485629 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce27da5_348e_495a_b1dd_cc7ebb70ac9a.slice/crio-a049512db83aa476fb5e1963e93cc6ae388da0a28c8e34ee6bbc063d8719bb92 WatchSource:0}: Error finding container a049512db83aa476fb5e1963e93cc6ae388da0a28c8e34ee6bbc063d8719bb92: Status 404 returned error can't find the container with id a049512db83aa476fb5e1963e93cc6ae388da0a28c8e34ee6bbc063d8719bb92 Jul 01 19:22:59.487150 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:22:59.487125 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf98f927_aeec_411e_8453_48e276a013b0.slice/crio-e9b9b4a33ee584f9d5d9d7fe975b65645fd73e40c838c6d1c2720ff953b4364e WatchSource:0}: Error finding container e9b9b4a33ee584f9d5d9d7fe975b65645fd73e40c838c6d1c2720ff953b4364e: Status 404 returned error can't find the container with id e9b9b4a33ee584f9d5d9d7fe975b65645fd73e40c838c6d1c2720ff953b4364e Jul 01 19:22:59.944547 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:59.944281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:22:59.944733 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.944604 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:59.944733 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.944678 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:01.944661647 +0000 UTC m=+6.090635367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:22:59.944733 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.944695 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:59.944984 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:22:59.944753 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:23:01.944735786 +0000 UTC m=+6.090709527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:22:59.944984 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:22:59.944601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:00.045493 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.045404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:00.045741 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.045596 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:00.045741 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.045621 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:00.045741 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.045635 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:00.045741 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.045712 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:02.04569096 +0000 UTC m=+6.191664680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:00.273636 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.273525 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 19:17:58 +0000 UTC" deadline="2028-01-11 06:35:45.971134561 +0000 UTC" Jul 01 19:23:00.273636 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.273609 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13403h12m45.697529206s" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.284371 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.284507 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.284967 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.285095 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.285164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:00.287799 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:00.285239 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:00.314482 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.314323 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xswkr" event={"ID":"09395a8c-6f48-4cd2-9e54-fa9badae427b","Type":"ContainerStarted","Data":"0c0cf378851112141c0a551edae4e96cff0bae91ee86b53ce399a2f5d341872d"} Jul 01 19:23:00.324504 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.324229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" event={"ID":"5296786a-f02a-46b0-9f7c-b78bb738d9b0","Type":"ContainerStarted","Data":"7b06d4109e3952127487cb0dd6f55980ade74a4759c9cb8d169febdc1edd9225"} Jul 01 19:23:00.335193 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.335153 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxzvw" event={"ID":"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad","Type":"ContainerStarted","Data":"22857e71b3a8df832b26a48f13681000722a1bd4ec4c32e8b11e1cc76931b0ac"} Jul 01 19:23:00.337442 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.337410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ggsps" event={"ID":"6e7caaa8-3887-4146-b2a8-f61eb06c6351","Type":"ContainerStarted","Data":"41da13a7203b0b637773dbc1e7a3eb054fee138a788410c053dc70c04bc1a4d0"} Jul 01 19:23:00.340116 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.340051 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fd8f2" event={"ID":"cf98f927-aeec-411e-8453-48e276a013b0","Type":"ContainerStarted","Data":"e9b9b4a33ee584f9d5d9d7fe975b65645fd73e40c838c6d1c2720ff953b4364e"} Jul 01 19:23:00.345210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.345131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" event={"ID":"fcd77b49-99c9-47de-8df3-5cf1da63909d","Type":"ContainerStarted","Data":"ebc5e4d76ba6df17e56da0bc7b1d4a2f92a51e558f82265e2f58e1a119a09fd3"} Jul 01 19:23:00.350691 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.350612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerStarted","Data":"5013969a976aad78eccef2a15397a169ce764ae86dd4785d6e39d4ebe2a4cdea"} Jul 01 19:23:00.361400 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.361370 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" event={"ID":"15f196c730bb2d51f2a3cacfe68d0520","Type":"ContainerStarted","Data":"73c7444af854386eef67511cc93a65a223cd6e49a3186fd46e935156da7ea85c"} Jul 01 19:23:00.370382 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.370352 2563 generic.go:356] "Generic (PLEG): container finished" podID="354079333571f1bca510c91f3f489015" containerID="4905a1dbb3ff8c81488e9e7b200607877ac766fd6a0189cb12080363c27b7c37" exitCode=0 Jul 01 19:23:00.370493 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.370434 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"354079333571f1bca510c91f3f489015","Type":"ContainerDied","Data":"4905a1dbb3ff8c81488e9e7b200607877ac766fd6a0189cb12080363c27b7c37"} Jul 01 19:23:00.373300 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.373194 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"42f00fd71a610051ed2796e806baf6f59e8b1ab48e89b95d823455055a83f950"} Jul 01 19:23:00.380366 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.380330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wk8b7" event={"ID":"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a","Type":"ContainerStarted","Data":"a049512db83aa476fb5e1963e93cc6ae388da0a28c8e34ee6bbc063d8719bb92"} Jul 01 19:23:00.409732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:00.409654 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-25.ec2.internal" podStartSLOduration=3.409630245 podStartE2EDuration="3.409630245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:00.387161547 +0000 UTC m=+4.533135290" watchObservedRunningTime="2026-07-01 19:23:00.409630245 +0000 UTC m=+4.555603992" Jul 01 19:23:01.391150 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:01.390936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" event={"ID":"354079333571f1bca510c91f3f489015","Type":"ContainerStarted","Data":"2b2bc377fde699231f037f2f4bbb5f4a9be4daf52a98dfa6fa5086c6613d63e1"} Jul 01 19:23:01.962462 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:01.962425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:01.962626 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:01.962487 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:01.962685 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:01.962656 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:01.962734 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:01.962715 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:23:05.962696915 +0000 UTC m=+10.108670654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:01.963134 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:01.963115 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:01.963230 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:01.963173 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:05.963157106 +0000 UTC m=+10.109130839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:02.063448 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:02.063411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:02.063692 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.063652 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:02.063692 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.063679 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:02.063692 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.063693 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:02.063934 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.063828 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:06.063733676 +0000 UTC m=+10.209707414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:02.283891 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.284018 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:02.284379 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.284477 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:02.284520 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:02.286944 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:02.284590 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:04.283983 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:04.283947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:04.284412 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:04.284093 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:04.284412 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:04.284164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:04.284412 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:04.284240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:04.284412 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:04.284303 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:04.284412 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:04.284374 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:05.995785 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:05.995747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:05.996239 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:05.995802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:05.996239 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:05.995966 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:05.996239 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:05.996031 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:23:13.996009953 +0000 UTC m=+18.141983695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:05.996483 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:05.996403 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:05.996483 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:05.996452 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:13.996439137 +0000 UTC m=+18.142412861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:06.096938 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:06.096889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:06.097116 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.097019 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:06.097116 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.097042 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:06.097116 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.097056 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:06.097116 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.097105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:14.097091427 +0000 UTC m=+18.243065148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:06.287666 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:06.287592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:06.287811 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.287707 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:06.287971 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:06.287945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:06.288089 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.288044 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:06.288154 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:06.288096 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:06.288201 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:06.288175 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:08.287487 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:08.287457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:08.287487 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:08.287475 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:08.288049 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:08.287457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:08.288049 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:08.287575 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:08.288049 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:08.287660 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:08.288049 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:08.287761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:10.283982 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:10.283948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:10.284427 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:10.284062 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:10.284427 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:10.284085 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:10.284427 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:10.283949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:10.284427 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:10.284204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:10.284427 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:10.284279 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:12.284229 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:12.284188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:12.284626 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:12.284188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:12.284626 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:12.284324 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:12.284626 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:12.284373 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:12.284626 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:12.284188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:12.284626 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:12.284444 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:14.060732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.060692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:14.060732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.060737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:14.061149 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.060849 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:14.061149 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.060853 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:14.061149 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.060918 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:23:30.060903938 +0000 UTC m=+34.206877657 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:14.061149 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.060931 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:30.060925745 +0000 UTC m=+34.206899463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:14.161509 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.161471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:14.161662 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.161623 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:14.161662 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.161646 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:14.161662 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.161657 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:14.161824 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.161723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:30.161703883 +0000 UTC m=+34.307677602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:14.284102 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.284027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:14.284249 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.284150 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:14.284523 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.284480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:14.284642 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.284571 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:14.284642 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:14.284630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:14.284752 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:14.284731 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:16.284930 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:16.284899 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:16.285375 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:16.285008 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:16.285375 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:16.285053 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:16.285375 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:16.285058 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:16.285375 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:16.285123 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:16.285375 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:16.285204 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:18.284379 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:18.284340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:18.285066 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:18.284474 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:18.285066 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:18.284849 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:18.285066 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:18.284949 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:18.285066 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:18.284993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:18.285286 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:18.285097 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:19.429551 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.429284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.429859 2563 generic.go:356] "Generic (PLEG): container finished" podID="2dfd2119-0194-4538-baca-4512b4dc4e76" containerID="b0714e365ee484643ccb6778301bab6457322b8aeddfe5ead66c8382e9ec62c7" exitCode=1 Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.429910 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"f5a537023d629ab061ed4e24b47399239efff1a6adf05b06cb98f2a14b29acf5"} Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.430001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"e4e0a3ad6d6984f6fe369f2774c13fffa52bab33c8a519e74863550b1927d5a1"} Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.430036 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"ce0b2e12bf2ebedc84d586af69e715c469a6d2fc8fd33fba4c6a9db8e878501d"} Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.430113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"68ee35b00e815ffa87cab476de18b3a3a18468e78621ba7670277082fb55cced"} Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.430157 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerDied","Data":"b0714e365ee484643ccb6778301bab6457322b8aeddfe5ead66c8382e9ec62c7"} Jul 01 19:23:19.430252 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.430207 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"31619959ed3f4a4e77f96c4d2b6bce36bdd8e52c02f9723ba68f5339f17dd16c"} Jul 01 19:23:19.431400 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.431375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wk8b7" event={"ID":"0ce27da5-348e-495a-b1dd-cc7ebb70ac9a","Type":"ContainerStarted","Data":"b9d136656121af43568050473f0da09ec6a2783f714161a9692f350c69718fc0"} Jul 01 19:23:19.432662 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.432643 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" event={"ID":"5296786a-f02a-46b0-9f7c-b78bb738d9b0","Type":"ContainerStarted","Data":"d2bbac25673e354d1ea25598c2a19c790cf3ededf8f90d5fd8876ba2d4730004"} Jul 01 19:23:19.434022 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.434001 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxzvw" event={"ID":"ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad","Type":"ContainerStarted","Data":"8b8d70a3531dd9aa2af7ec070d38af49816e4e11b46a8fc0ba40d328eecb5fb1"} Jul 01 19:23:19.435625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.435606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ggsps" event={"ID":"6e7caaa8-3887-4146-b2a8-f61eb06c6351","Type":"ContainerStarted","Data":"f0fecb982a1aae24e94a5881f234ccfb09cbea47a56d4a91d7f8b53ff52d08be"} Jul 01 19:23:19.436999 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.436981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fd8f2" event={"ID":"cf98f927-aeec-411e-8453-48e276a013b0","Type":"ContainerStarted","Data":"f47adee9d7f176368018c7ac21742c48f053dbd2708fd4342bb02d3ef7b65a98"} Jul 01 19:23:19.438357 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.438337 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" event={"ID":"fcd77b49-99c9-47de-8df3-5cf1da63909d","Type":"ContainerStarted","Data":"82f4afdd1ffbeb62b8eb5af2542e1ec18269d9ae4ce8d7e2536934d9d690c279"} Jul 01 19:23:19.439650 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.439631 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="d66b43a0addda00c951bd3d2b8ab99da74f7e76b85c7f6c106066c3d38bcfda9" exitCode=0 Jul 01 19:23:19.439720 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.439661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"d66b43a0addda00c951bd3d2b8ab99da74f7e76b85c7f6c106066c3d38bcfda9"} Jul 01 19:23:19.447288 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.447255 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wk8b7" podStartSLOduration=8.786813868 podStartE2EDuration="23.447242485s" totalImagesPullingTime="14.660428617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:19.446989349 +0000 UTC m=+23.592963091" watchObservedRunningTime="2026-07-01 19:23:19.447242485 +0000 UTC m=+23.593216226" Jul 01 19:23:19.447513 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.447492 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-25.ec2.internal" podStartSLOduration=22.447479503 podStartE2EDuration="22.447479503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:01.426616677 +0000 UTC m=+5.572590421" watchObservedRunningTime="2026-07-01 19:23:19.447479503 +0000 UTC m=+23.593453244" Jul 01 19:23:19.462031 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.461999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qxzvw" podStartSLOduration=4.4746249129999995 podStartE2EDuration="23.461988437s" totalImagesPullingTime="18.987363524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:19.461426468 +0000 UTC m=+23.607400206" watchObservedRunningTime="2026-07-01 19:23:19.461988437 +0000 UTC m=+23.607962177" Jul 01 19:23:19.498341 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.498300 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fd8f2" podStartSLOduration=4.527026889 podStartE2EDuration="23.498287778s" totalImagesPullingTime="18.971260889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:19.475630231 +0000 UTC m=+23.621603991" watchObservedRunningTime="2026-07-01 19:23:19.498287778 +0000 UTC m=+23.644261546" Jul 01 19:23:19.516702 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.516662 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8rfrv" podStartSLOduration=4.53798255 podStartE2EDuration="23.516647953s" totalImagesPullingTime="18.978665403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:19.516488144 +0000 UTC m=+23.662461885" watchObservedRunningTime="2026-07-01 19:23:19.516647953 +0000 UTC m=+23.662621713" Jul 01 19:23:19.534894 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:19.534830 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ggsps" podStartSLOduration=4.504463426 podStartE2EDuration="23.53481156s" totalImagesPullingTime="19.030348134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:19.534551433 +0000 UTC m=+23.680525174" watchObservedRunningTime="2026-07-01 19:23:19.53481156 +0000 UTC m=+23.680785303" Jul 01 19:23:20.283438 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.283364 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:20.283606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.283365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:20.283606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.283491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:20.283606 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:20.283560 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:20.283606 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:20.283455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:20.283748 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:20.283655 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:20.443387 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.443343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xswkr" event={"ID":"09395a8c-6f48-4cd2-9e54-fa9badae427b","Type":"ContainerStarted","Data":"8ba32bca24a9ac66702b026be42c02cd0900afd264e6febbb99d388d5ef513b5"} Jul 01 19:23:20.459414 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.459374 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xswkr" podStartSLOduration=5.485039079 podStartE2EDuration="24.459359507s" totalImagesPullingTime="18.974320428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:20.459126707 +0000 UTC m=+24.605100448" watchObservedRunningTime="2026-07-01 19:23:20.459359507 +0000 UTC m=+24.605333247" Jul 01 19:23:20.984107 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:20.984070 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 19:23:21.286015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:21.285855 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T19:23:20.984091224Z","UUID":"30a3339d-5c00-4db1-9ac4-66cd218b80d6","Handler":null,"Name":"","Endpoint":""} Jul 01 19:23:21.287340 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:21.287319 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 19:23:21.287483 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:21.287365 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 19:23:21.447390 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:21.447351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" event={"ID":"5296786a-f02a-46b0-9f7c-b78bb738d9b0","Type":"ContainerStarted","Data":"bb70ec0d04379d8487634a5a5a034e61193b5d05dae4a3f714a640e1c82c894a"} Jul 01 19:23:22.284513 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.284328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:22.284680 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:22.284597 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:22.284680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.284386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:22.284680 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:22.284658 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:22.284680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.284344 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:22.284930 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:22.284724 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:22.316585 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.316522 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:23:22.317122 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.317103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:23:22.452506 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.452422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" event={"ID":"5296786a-f02a-46b0-9f7c-b78bb738d9b0","Type":"ContainerStarted","Data":"b8ee49c5775ccc7707795ea3bbb72258dbe440d6f7eabbe8f32c6b560a9cb5cf"} Jul 01 19:23:22.456438 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.456414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:23:22.456840 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.456800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"da9ba8bacc619d1d801d6500cb303ca76bc2789b8466852bc734e2f16ad002b9"} Jul 01 19:23:22.471499 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:22.471455 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f4rkr" podStartSLOduration=4.213507221 podStartE2EDuration="26.471440951s" totalImagesPullingTime="22.25793373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:22.470919461 +0000 UTC m=+26.616893201" watchObservedRunningTime="2026-07-01 19:23:22.471440951 +0000 UTC m=+26.617414693" Jul 01 19:23:24.284188 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.284124 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:24.284689 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.284127 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:24.284689 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.284270 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:24.284689 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:24.284278 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:24.284689 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:24.284353 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:24.284689 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:24.284419 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:24.464240 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.464114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:23:24.464582 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.464562 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"4729bd0d1c9de94b4c7fe456158c8d9df5a6c5b0214e5108f4f0bd4e144dad0d"} Jul 01 19:23:24.464851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.464828 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:24.465126 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.464924 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:24.465126 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.465046 2563 scope.go:117] "RemoveContainer" containerID="b0714e365ee484643ccb6778301bab6457322b8aeddfe5ead66c8382e9ec62c7" Jul 01 19:23:24.481125 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:24.481096 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:25.470400 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.470374 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:23:25.470843 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.470746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" event={"ID":"2dfd2119-0194-4538-baca-4512b4dc4e76","Type":"ContainerStarted","Data":"72f3779fd4ff238bee74d8b5cef978ca103d974c627a1a4ae7976dd985d930c6"} Jul 01 19:23:25.471044 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.471021 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:25.472732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.472711 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="20a8ae04856c7a87bac549420596a969f6b95965fece5292441962e9a5b99bac" exitCode=0 Jul 01 19:23:25.472829 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.472751 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"20a8ae04856c7a87bac549420596a969f6b95965fece5292441962e9a5b99bac"} Jul 01 19:23:25.487138 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.487116 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:25.548293 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:25.548195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" podStartSLOduration=10.240123235 podStartE2EDuration="29.548180293s" totalImagesPullingTime="19.308057058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:25.513989616 +0000 UTC m=+29.659963357" watchObservedRunningTime="2026-07-01 19:23:25.548180293 +0000 UTC m=+29.694154035" Jul 01 19:23:26.284806 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.284774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:26.284973 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.284832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:26.284973 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.284944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:26.285175 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.285147 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:26.285951 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.285212 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:26.286857 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.286799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:26.476519 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.476280 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="e726082ab1a0fcab7e62013aaf46841c312a3ee09a83e2fe35c2432302ff5363" exitCode=0 Jul 01 19:23:26.476519 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.476365 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"e726082ab1a0fcab7e62013aaf46841c312a3ee09a83e2fe35c2432302ff5363"} Jul 01 19:23:26.555791 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.555750 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gczjd"] Jul 01 19:23:26.555998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.555851 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:26.555998 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.555969 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:26.556555 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.556537 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lcpjl"] Jul 01 19:23:26.556668 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.556622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:26.556722 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.556694 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:26.557105 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.557082 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bt4tw"] Jul 01 19:23:26.557219 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:26.557175 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:26.557274 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:26.557252 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:27.481398 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:27.481322 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="7c27777325a5cb7bbfcc8eebeecd344f198891f91243a4dd975f5ea2395410c8" exitCode=0 Jul 01 19:23:27.481857 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:27.481413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"7c27777325a5cb7bbfcc8eebeecd344f198891f91243a4dd975f5ea2395410c8"} Jul 01 19:23:27.552141 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:27.552109 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:23:27.552317 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:27.552235 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 19:23:27.552676 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:27.552658 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wk8b7" Jul 01 19:23:28.283594 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:28.283560 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:28.283779 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:28.283560 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:28.283779 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:28.283709 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:28.283779 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:28.283746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:28.283970 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:28.283852 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:28.284023 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:28.283984 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:30.081446 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.081411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:30.081998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.081471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:30.081998 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.081594 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:30.081998 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.081610 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:30.081998 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.081662 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret podName:ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:02.081647716 +0000 UTC m=+66.227621454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret") pod "global-pull-secret-syncer-lcpjl" (UID: "ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 19:23:30.081998 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.081679 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:24:02.081672203 +0000 UTC m=+66.227645926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 19:23:30.182536 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.182499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:30.182712 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.182695 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 19:23:30.182779 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.182721 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 19:23:30.182779 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.182737 2563 projected.go:196] Error preparing data for projected volume kube-api-access-fjbw9 for pod openshift-network-diagnostics/network-check-target-gczjd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:30.182871 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.182805 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9 podName:53a2443d-df99-41ac-bad6-27eeb7b3cdf6 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:02.182785563 +0000 UTC m=+66.328759298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjbw9" (UniqueName: "kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9") pod "network-check-target-gczjd" (UID: "53a2443d-df99-41ac-bad6-27eeb7b3cdf6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 19:23:30.283344 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.283309 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:30.283518 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.283360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:30.283518 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:30.283439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:30.283518 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.283455 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bt4tw" podUID="c3327b66-7666-4066-9d83-8af7c759a53f" Jul 01 19:23:30.283675 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.283529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lcpjl" podUID="ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1" Jul 01 19:23:30.283675 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:30.283645 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gczjd" podUID="53a2443d-df99-41ac-bad6-27eeb7b3cdf6" Jul 01 19:23:31.652466 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.652399 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-25.ec2.internal" event="NodeReady" Jul 01 19:23:31.652914 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.652533 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 19:23:31.731630 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.731605 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xsq8v"] Jul 01 19:23:31.754109 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.754083 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fgjzg"] Jul 01 19:23:31.754248 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.754216 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:31.757754 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.757711 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 19:23:31.758340 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.758308 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-krlqs\"" Jul 01 19:23:31.758828 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.758571 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 19:23:31.758828 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.758664 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 19:23:31.774585 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.774566 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsq8v"] Jul 01 19:23:31.774664 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.774593 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fgjzg"] Jul 01 19:23:31.774700 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.774670 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.777997 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.777979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 19:23:31.778138 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.778125 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b6mr\"" Jul 01 19:23:31.778710 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.778693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 19:23:31.896055 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1970e54-c8a9-48ab-bb1a-22c7740071c7-tmp-dir\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.896171 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbm5b\" (UniqueName: \"kubernetes.io/projected/e1970e54-c8a9-48ab-bb1a-22c7740071c7-kube-api-access-sbm5b\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.896171 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896084 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-cert\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:31.896171 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1970e54-c8a9-48ab-bb1a-22c7740071c7-config-volume\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.896268 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.896268 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.896196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4trz\" (UniqueName: \"kubernetes.io/projected/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-kube-api-access-n4trz\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:31.996582 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1970e54-c8a9-48ab-bb1a-22c7740071c7-config-volume\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.996670 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.996670 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4trz\" (UniqueName: \"kubernetes.io/projected/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-kube-api-access-n4trz\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:31.996769 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1970e54-c8a9-48ab-bb1a-22c7740071c7-tmp-dir\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.996769 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbm5b\" (UniqueName: \"kubernetes.io/projected/e1970e54-c8a9-48ab-bb1a-22c7740071c7-kube-api-access-sbm5b\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.996769 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.996730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-cert\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:31.996945 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:31.996777 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:31.996945 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:31.996865 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:32.49684473 +0000 UTC m=+36.642818472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:31.997166 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.997143 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1970e54-c8a9-48ab-bb1a-22c7740071c7-tmp-dir\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:31.997229 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:31.997198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1970e54-c8a9-48ab-bb1a-22c7740071c7-config-volume\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:32.002517 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.002470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-cert\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:32.007950 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.007927 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbm5b\" (UniqueName: \"kubernetes.io/projected/e1970e54-c8a9-48ab-bb1a-22c7740071c7-kube-api-access-sbm5b\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:32.007950 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.007945 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4trz\" (UniqueName: \"kubernetes.io/projected/25f29a38-ccf8-4aa5-8b88-7125295b8e6b-kube-api-access-n4trz\") pod \"ingress-canary-xsq8v\" (UID: \"25f29a38-ccf8-4aa5-8b88-7125295b8e6b\") " pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:32.065449 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.065302 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xsq8v" Jul 01 19:23:32.274782 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.274751 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xsq8v"] Jul 01 19:23:32.278276 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:23:32.278246 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f29a38_ccf8_4aa5_8b88_7125295b8e6b.slice/crio-b7efc8b0fe7b2b41e4fff598a24830aca7d76a9e16e035b00f821577dbb5dae3 WatchSource:0}: Error finding container b7efc8b0fe7b2b41e4fff598a24830aca7d76a9e16e035b00f821577dbb5dae3: Status 404 returned error can't find the container with id b7efc8b0fe7b2b41e4fff598a24830aca7d76a9e16e035b00f821577dbb5dae3 Jul 01 19:23:32.284348 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.284329 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:23:32.284422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.284332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:23:32.284483 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.284446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:23:32.287222 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287141 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:23:32.287222 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:23:32.287222 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287177 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqcw7\"" Jul 01 19:23:32.287507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287293 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tgvrs\"" Jul 01 19:23:32.287507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:23:32.287507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.287497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:23:32.497945 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.497843 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="0301c3263faa4db986dcf06542c6823bee279a2cec0123e19da750e286167a1b" exitCode=0 Jul 01 19:23:32.498090 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.497939 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"0301c3263faa4db986dcf06542c6823bee279a2cec0123e19da750e286167a1b"} Jul 01 19:23:32.499008 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.498987 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsq8v" event={"ID":"25f29a38-ccf8-4aa5-8b88-7125295b8e6b","Type":"ContainerStarted","Data":"b7efc8b0fe7b2b41e4fff598a24830aca7d76a9e16e035b00f821577dbb5dae3"} Jul 01 19:23:32.501636 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:32.501613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:32.501773 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:32.501758 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:32.501833 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:32.501813 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:33.50179748 +0000 UTC m=+37.647771199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:33.505335 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:33.505305 2563 generic.go:356] "Generic (PLEG): container finished" podID="d4747c29-a163-4616-9373-f0e6545d3f6b" containerID="3140201bd09d5375e4137d34c66549cb80843437710b4b8f48e86d8012b2db13" exitCode=0 Jul 01 19:23:33.505720 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:33.505349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerDied","Data":"3140201bd09d5375e4137d34c66549cb80843437710b4b8f48e86d8012b2db13"} Jul 01 19:23:33.508863 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:33.508836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:33.509007 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:33.508961 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:33.509064 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:33.509012 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:35.508994864 +0000 UTC m=+39.654968587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:34.513153 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:34.512915 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" event={"ID":"d4747c29-a163-4616-9373-f0e6545d3f6b","Type":"ContainerStarted","Data":"a6debf858c59a9d92401e522cde201c9db011c2e23030c55d3156cce4c637899"} Jul 01 19:23:34.540099 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:34.540036 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hvt5n" podStartSLOduration=8.587531414 podStartE2EDuration="38.540014639s" totalImagesPullingTime="29.952483225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:34.539189068 +0000 UTC m=+38.685162831" watchObservedRunningTime="2026-07-01 19:23:34.540014639 +0000 UTC m=+38.685988382" Jul 01 19:23:35.516673 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:35.516645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xsq8v" event={"ID":"25f29a38-ccf8-4aa5-8b88-7125295b8e6b","Type":"ContainerStarted","Data":"1db5f52511ca01bb9f3303872cbdb666cc3ceb488773210a0977e5163e8a7e0f"} Jul 01 19:23:35.525856 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:35.525830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:35.525992 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:35.525938 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:35.525992 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:35.525989 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:39.525972518 +0000 UTC m=+43.671946237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:35.540630 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:35.540586 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xsq8v" podStartSLOduration=1.9751308079999998 podStartE2EDuration="4.540571682s" totalImagesPullingTime="2.565440874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:35.540471459 +0000 UTC m=+39.686445201" watchObservedRunningTime="2026-07-01 19:23:35.540571682 +0000 UTC m=+39.686545421" Jul 01 19:23:39.552712 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:39.552678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:39.553207 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:39.552843 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:39.553207 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:39.552928 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:47.552908013 +0000 UTC m=+51.698881749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:47.609501 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:47.609460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:23:47.609975 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:47.609594 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:23:47.609975 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:47.609662 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.609646512 +0000 UTC m=+67.755620231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:23:55.690116 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.690080 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt"] Jul 01 19:23:55.711839 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.711812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" Jul 01 19:23:55.726939 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.726915 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.727387 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.727362 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt"] Jul 01 19:23:55.727512 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.727491 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.729138 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.729121 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9t4hb\"" Jul 01 19:23:55.762924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.762894 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtcmw\" (UniqueName: \"kubernetes.io/projected/e2e165d2-6775-4f23-9444-6fa8eec817f6-kube-api-access-wtcmw\") pod \"volume-data-source-validator-69d9f679db-tf4gt\" (UID: \"e2e165d2-6775-4f23-9444-6fa8eec817f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" Jul 01 19:23:55.803832 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.803800 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74"] Jul 01 19:23:55.826608 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.826581 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74"] Jul 01 19:23:55.826758 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.826692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.833395 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.833377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.834708 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.834692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w8cxg\"" Jul 01 19:23:55.834794 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.834754 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 19:23:55.835013 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.834999 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 19:23:55.835095 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.835082 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.863847 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.863823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23a58980-1db2-41a9-8f73-92e54d52b062-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.863961 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.863848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.863961 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.863908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtcmw\" (UniqueName: \"kubernetes.io/projected/e2e165d2-6775-4f23-9444-6fa8eec817f6-kube-api-access-wtcmw\") pod \"volume-data-source-validator-69d9f679db-tf4gt\" (UID: \"e2e165d2-6775-4f23-9444-6fa8eec817f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" Jul 01 19:23:55.863961 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.863930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfzl\" (UniqueName: \"kubernetes.io/projected/23a58980-1db2-41a9-8f73-92e54d52b062-kube-api-access-hgfzl\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.889730 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.889707 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-c4nzb"] Jul 01 19:23:55.893854 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.893837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtcmw\" (UniqueName: \"kubernetes.io/projected/e2e165d2-6775-4f23-9444-6fa8eec817f6-kube-api-access-wtcmw\") pod \"volume-data-source-validator-69d9f679db-tf4gt\" (UID: \"e2e165d2-6775-4f23-9444-6fa8eec817f6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" Jul 01 19:23:55.904767 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.904746 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-c4nzb"] Jul 01 19:23:55.904857 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.904839 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.908568 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.908551 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 19:23:55.908739 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.908720 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wvc47\"" Jul 01 19:23:55.908832 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.908809 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 19:23:55.908907 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.908847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 19:23:55.909208 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.909192 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 19:23:55.914012 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.913996 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 19:23:55.964927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.964845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-tmp\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.964927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.964890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-service-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.965061 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.964945 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-snapshots\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.965061 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.964980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfzl\" (UniqueName: \"kubernetes.io/projected/23a58980-1db2-41a9-8f73-92e54d52b062-kube-api-access-hgfzl\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.965061 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-serving-cert\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.965153 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965083 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23a58980-1db2-41a9-8f73-92e54d52b062-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.965153 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965100 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.965153 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.965153 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stltl\" (UniqueName: \"kubernetes.io/projected/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-kube-api-access-stltl\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:55.965289 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:55.965219 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:55.965323 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:55.965295 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.465274146 +0000 UTC m=+60.611247867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:55.965803 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.965786 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/23a58980-1db2-41a9-8f73-92e54d52b062-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:55.975907 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:55.975870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfzl\" (UniqueName: \"kubernetes.io/projected/23a58980-1db2-41a9-8f73-92e54d52b062-kube-api-access-hgfzl\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:56.021126 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.021099 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" Jul 01 19:23:56.065772 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.065716 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-serving-cert\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.065864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.065919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stltl\" (UniqueName: \"kubernetes.io/projected/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-kube-api-access-stltl\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.065951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-tmp\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.065977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-service-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.066009 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-snapshots\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.066376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-tmp\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.066619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-snapshots\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.067809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.066953 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-service-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.068900 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.068833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.069308 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.069284 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-serving-cert\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.075655 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.075627 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stltl\" (UniqueName: \"kubernetes.io/projected/b4a45f67-7c52-48a3-b8c3-52833d2d0c7c-kube-api-access-stltl\") pod \"insights-operator-5f67b55555-c4nzb\" (UID: \"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c\") " pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.158542 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.158512 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt"] Jul 01 19:23:56.161847 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:23:56.161819 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e165d2_6775_4f23_9444_6fa8eec817f6.slice/crio-6923ffbc12a3bb5130c35f9e3d48d0092ec2ca4d9279feb319ff0a9521c08adc WatchSource:0}: Error finding container 6923ffbc12a3bb5130c35f9e3d48d0092ec2ca4d9279feb319ff0a9521c08adc: Status 404 returned error can't find the container with id 6923ffbc12a3bb5130c35f9e3d48d0092ec2ca4d9279feb319ff0a9521c08adc Jul 01 19:23:56.218359 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.218282 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wvc47\"" Jul 01 19:23:56.225324 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.225300 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" Jul 01 19:23:56.346480 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.346436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59447d84d5-r24cd"] Jul 01 19:23:56.348974 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.348951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.352496 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.352476 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 19:23:56.352946 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.352918 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 19:23:56.352946 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.352923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fc4hm\"" Jul 01 19:23:56.353103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.352987 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 19:23:56.359385 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.359361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-c4nzb"] Jul 01 19:23:56.362132 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.362114 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 19:23:56.363215 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:23:56.363195 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a45f67_7c52_48a3_b8c3_52833d2d0c7c.slice/crio-41c198bec03f72a250eaf171db33cd1fcccbd71841d1dec57602e2866bc2005e WatchSource:0}: Error finding container 41c198bec03f72a250eaf171db33cd1fcccbd71841d1dec57602e2866bc2005e: Status 404 returned error can't find the container with id 41c198bec03f72a250eaf171db33cd1fcccbd71841d1dec57602e2866bc2005e Jul 01 19:23:56.368547 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368632 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368670 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368700 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368776 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.368838 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.368780 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmgr\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.369155 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.369121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.370483 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.370464 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59447d84d5-r24cd"] Jul 01 19:23:56.470109 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470015 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:56.470109 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.470189 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.470260 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.470239666 +0000 UTC m=+61.616213406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmgr\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470784 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470771 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470845 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.470778 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.470845 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.470830 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:23:56.470967 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.470849 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:23:56.470967 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.470926 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:23:56.970909332 +0000 UTC m=+61.116883065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:23:56.471316 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.471296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.472870 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.472851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.472925 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.472902 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.482678 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.482650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.483040 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.483024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmgr\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.564362 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.564321 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" event={"ID":"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c","Type":"ContainerStarted","Data":"41c198bec03f72a250eaf171db33cd1fcccbd71841d1dec57602e2866bc2005e"} Jul 01 19:23:56.565455 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.565418 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" event={"ID":"e2e165d2-6775-4f23-9444-6fa8eec817f6","Type":"ContainerStarted","Data":"6923ffbc12a3bb5130c35f9e3d48d0092ec2ca4d9279feb319ff0a9521c08adc"} Jul 01 19:23:56.975056 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:56.974989 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:56.975525 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.975164 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:23:56.975525 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.975188 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:23:56.975525 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:56.975265 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:23:57.975239822 +0000 UTC m=+62.121213564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:23:57.479046 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:57.479010 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:57.479184 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:57.479125 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:57.479184 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:57.479184 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:23:59.479170577 +0000 UTC m=+63.625144296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:57.493283 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:57.493251 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dd4gr" Jul 01 19:23:57.568681 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:57.568641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" event={"ID":"e2e165d2-6775-4f23-9444-6fa8eec817f6","Type":"ContainerStarted","Data":"dfa282816de120ea1cbe91bf479caa59dcc5999ed0ccf7267b1894877ca4c188"} Jul 01 19:23:57.983341 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:57.983299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:23:57.983947 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:57.983465 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:23:57.983947 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:57.983484 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:23:57.983947 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:57.983554 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:23:59.983537575 +0000 UTC m=+64.129511296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:23:58.572536 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.572498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" event={"ID":"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c","Type":"ContainerStarted","Data":"7d9995e48115e863ef9f197d8fabea3dca8856016b826da5ba7f409ecaac9cff"} Jul 01 19:23:58.603624 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.603567 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" podStartSLOduration=1.804852632 podStartE2EDuration="3.603545581s" totalImagesPullingTime="1.798692949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:58.602374074 +0000 UTC m=+62.748347828" watchObservedRunningTime="2026-07-01 19:23:58.603545581 +0000 UTC m=+62.749519323" Jul 01 19:23:58.604197 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.604168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-tf4gt" podStartSLOduration=2.370875873 podStartE2EDuration="3.604159052s" totalImagesPullingTime="1.233283179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:23:57.597792924 +0000 UTC m=+61.743766665" watchObservedRunningTime="2026-07-01 19:23:58.604159052 +0000 UTC m=+62.750132794" Jul 01 19:23:58.680608 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.680578 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6"] Jul 01 19:23:58.682581 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.682565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.685215 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.685190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:23:58.685442 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.685418 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 01 19:23:58.685574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.685554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mb58z\"" Jul 01 19:23:58.685634 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.685559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 01 19:23:58.685634 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.685584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 01 19:23:58.700264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.700176 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6"] Jul 01 19:23:58.788898 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.788849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwscg\" (UniqueName: \"kubernetes.io/projected/13f53e22-1c5e-4d24-b391-669ee21b5a3f-kube-api-access-cwscg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.789068 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.788918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13f53e22-1c5e-4d24-b391-669ee21b5a3f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.789068 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.788955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f53e22-1c5e-4d24-b391-669ee21b5a3f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.890263 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.890178 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f53e22-1c5e-4d24-b391-669ee21b5a3f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.890365 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.890276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwscg\" (UniqueName: \"kubernetes.io/projected/13f53e22-1c5e-4d24-b391-669ee21b5a3f-kube-api-access-cwscg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.890365 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.890305 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13f53e22-1c5e-4d24-b391-669ee21b5a3f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.890829 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.890811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13f53e22-1c5e-4d24-b391-669ee21b5a3f-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.892520 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.892499 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13f53e22-1c5e-4d24-b391-669ee21b5a3f-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.899127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.899104 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwscg\" (UniqueName: \"kubernetes.io/projected/13f53e22-1c5e-4d24-b391-669ee21b5a3f-kube-api-access-cwscg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-kd5j6\" (UID: \"13f53e22-1c5e-4d24-b391-669ee21b5a3f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:58.992230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:58.992179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" Jul 01 19:23:59.123459 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.123370 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6"] Jul 01 19:23:59.126285 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:23:59.126256 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f53e22_1c5e_4d24_b391_669ee21b5a3f.slice/crio-cfa4c5643741129dc25ecfefcb2f0692023a5cc8a28da25486391e1173907e38 WatchSource:0}: Error finding container cfa4c5643741129dc25ecfefcb2f0692023a5cc8a28da25486391e1173907e38: Status 404 returned error can't find the container with id cfa4c5643741129dc25ecfefcb2f0692023a5cc8a28da25486391e1173907e38 Jul 01 19:23:59.439770 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.439734 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2wzcv"] Jul 01 19:23:59.442375 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.442357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.447641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.447609 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fr8gc\"" Jul 01 19:23:59.447923 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.447903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 19:23:59.452405 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.452200 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 19:23:59.463698 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.463673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wzcv"] Jul 01 19:23:59.495817 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.495786 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:23:59.496008 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.495836 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b752549-961e-49a0-b8c5-07a299dfa4b3-crio-socket\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.496008 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.495910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt552\" (UniqueName: \"kubernetes.io/projected/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-api-access-mt552\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.496008 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.495948 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:59.496008 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.495978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.496008 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.496005 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.495990527 +0000 UTC m=+67.641964249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:23:59.496229 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.496067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.496229 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.496119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b752549-961e-49a0-b8c5-07a299dfa4b3-data-volume\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.576212 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.576169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" event={"ID":"13f53e22-1c5e-4d24-b391-669ee21b5a3f","Type":"ContainerStarted","Data":"cfa4c5643741129dc25ecfefcb2f0692023a5cc8a28da25486391e1173907e38"} Jul 01 19:23:59.597098 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt552\" (UniqueName: \"kubernetes.io/projected/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-api-access-mt552\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597295 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597110 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597295 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597295 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b752549-961e-49a0-b8c5-07a299dfa4b3-data-volume\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.597296 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b752549-961e-49a0-b8c5-07a299dfa4b3-crio-socket\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.597376 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.097352085 +0000 UTC m=+64.243325996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.597297 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b752549-961e-49a0-b8c5-07a299dfa4b3-crio-socket\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.597531 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:23:59.597455 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:00.09742856 +0000 UTC m=+64.243402299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : configmap "kube-rbac-proxy" not found Jul 01 19:23:59.597726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.597648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b752549-961e-49a0-b8c5-07a299dfa4b3-data-volume\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:23:59.609518 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:23:59.609493 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt552\" (UniqueName: \"kubernetes.io/projected/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-api-access-mt552\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:00.002194 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.002148 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:00.002635 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.002300 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:24:00.002635 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.002315 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:24:00.002635 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.002374 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:24:04.002359907 +0000 UTC m=+68.148333639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:24:00.103269 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.103238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:00.103469 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.103281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:00.103469 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.103364 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:00.103469 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.103398 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:00.103469 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.103422 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:01.103403203 +0000 UTC m=+65.249376943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : configmap "kube-rbac-proxy" not found Jul 01 19:24:00.103643 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:00.103476 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:01.103457001 +0000 UTC m=+65.249430727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:00.668799 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.668767 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x"] Jul 01 19:24:00.670817 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.670800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.674059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.674033 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 19:24:00.674341 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.674326 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9h8gl\"" Jul 01 19:24:00.674926 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.674911 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 19:24:00.675066 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.675051 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 19:24:00.675154 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.675140 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 19:24:00.694782 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.694759 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x"] Jul 01 19:24:00.708262 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.708240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06fa14d-c14f-486e-ac5e-9dbaeb496360-config\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.708373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.708293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06fa14d-c14f-486e-ac5e-9dbaeb496360-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.708373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.708319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnx5w\" (UniqueName: \"kubernetes.io/projected/d06fa14d-c14f-486e-ac5e-9dbaeb496360-kube-api-access-gnx5w\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.809389 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.809360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06fa14d-c14f-486e-ac5e-9dbaeb496360-config\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.809528 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.809417 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06fa14d-c14f-486e-ac5e-9dbaeb496360-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.809528 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.809440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnx5w\" (UniqueName: \"kubernetes.io/projected/d06fa14d-c14f-486e-ac5e-9dbaeb496360-kube-api-access-gnx5w\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.810033 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.810011 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d06fa14d-c14f-486e-ac5e-9dbaeb496360-config\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.812011 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.811988 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d06fa14d-c14f-486e-ac5e-9dbaeb496360-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.819232 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.819212 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnx5w\" (UniqueName: \"kubernetes.io/projected/d06fa14d-c14f-486e-ac5e-9dbaeb496360-kube-api-access-gnx5w\") pod \"service-ca-operator-5d7b7dc95c-pvz9x\" (UID: \"d06fa14d-c14f-486e-ac5e-9dbaeb496360\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:00.979971 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:00.979944 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" Jul 01 19:24:01.111930 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:01.111895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:01.111930 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:01.111933 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:01.112335 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:01.112012 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:01.112335 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:01.112045 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:01.112335 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:01.112059 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.112046188 +0000 UTC m=+67.258019908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : configmap "kube-rbac-proxy" not found Jul 01 19:24:01.112335 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:01.112097 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:03.112084197 +0000 UTC m=+67.258057916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:01.121266 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:01.121243 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x"] Jul 01 19:24:01.124587 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:01.124567 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06fa14d_c14f_486e_ac5e_9dbaeb496360.slice/crio-aeee4073a39c6a6dda73f53a8dbd3d8650150589f88b3495ffbe0e8e4ec3f52b WatchSource:0}: Error finding container aeee4073a39c6a6dda73f53a8dbd3d8650150589f88b3495ffbe0e8e4ec3f52b: Status 404 returned error can't find the container with id aeee4073a39c6a6dda73f53a8dbd3d8650150589f88b3495ffbe0e8e4ec3f52b Jul 01 19:24:01.582843 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:01.582802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" event={"ID":"d06fa14d-c14f-486e-ac5e-9dbaeb496360","Type":"ContainerStarted","Data":"aeee4073a39c6a6dda73f53a8dbd3d8650150589f88b3495ffbe0e8e4ec3f52b"} Jul 01 19:24:01.680837 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:01.680806 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxzvw_ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad/dns-node-resolver/0.log" Jul 01 19:24:02.122224 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.122195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:24:02.122598 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.122374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:24:02.125367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.125338 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 19:24:02.125479 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.125455 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 19:24:02.133305 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:02.133276 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 19:24:02.133405 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:02.133353 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs podName:c3327b66-7666-4066-9d83-8af7c759a53f nodeName:}" failed. No retries permitted until 2026-07-01 19:25:06.13333104 +0000 UTC m=+130.279304758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs") pod "network-metrics-daemon-bt4tw" (UID: "c3327b66-7666-4066-9d83-8af7c759a53f") : secret "metrics-daemon-secret" not found Jul 01 19:24:02.135845 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.135820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1-original-pull-secret\") pod \"global-pull-secret-syncer-lcpjl\" (UID: \"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1\") " pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:24:02.223235 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.223203 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:24:02.229726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.229701 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 19:24:02.238281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.238260 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 19:24:02.248141 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.248118 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbw9\" (UniqueName: \"kubernetes.io/projected/53a2443d-df99-41ac-bad6-27eeb7b3cdf6-kube-api-access-fjbw9\") pod \"network-check-target-gczjd\" (UID: \"53a2443d-df99-41ac-bad6-27eeb7b3cdf6\") " pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:24:02.271023 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.270999 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fd8f2_cf98f927-aeec-411e-8453-48e276a013b0/node-ca/0.log" Jul 01 19:24:02.302170 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.302141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lcpjl" Jul 01 19:24:02.309507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.309484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tgvrs\"" Jul 01 19:24:02.316977 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.316949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:24:02.478542 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.478026 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lcpjl"] Jul 01 19:24:02.482346 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:02.482310 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8ff365_a7c7_437f_a1ed_5f8a7c29abc1.slice/crio-c8ca3d4e3e28e028a1fd026a2181a7a2cd0cddec7b2fd9ed00f1ec1df8dd7b0d WatchSource:0}: Error finding container c8ca3d4e3e28e028a1fd026a2181a7a2cd0cddec7b2fd9ed00f1ec1df8dd7b0d: Status 404 returned error can't find the container with id c8ca3d4e3e28e028a1fd026a2181a7a2cd0cddec7b2fd9ed00f1ec1df8dd7b0d Jul 01 19:24:02.494698 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.494673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gczjd"] Jul 01 19:24:02.501606 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:02.501580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a2443d_df99_41ac_bad6_27eeb7b3cdf6.slice/crio-0e44ac4ce35b195bf7183b6727235807a719f546e05910af3da1275b16c54699 WatchSource:0}: Error finding container 0e44ac4ce35b195bf7183b6727235807a719f546e05910af3da1275b16c54699: Status 404 returned error can't find the container with id 0e44ac4ce35b195bf7183b6727235807a719f546e05910af3da1275b16c54699 Jul 01 19:24:02.586964 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.586923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gczjd" event={"ID":"53a2443d-df99-41ac-bad6-27eeb7b3cdf6","Type":"ContainerStarted","Data":"0e44ac4ce35b195bf7183b6727235807a719f546e05910af3da1275b16c54699"} Jul 01 19:24:02.588602 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.588548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" event={"ID":"13f53e22-1c5e-4d24-b391-669ee21b5a3f","Type":"ContainerStarted","Data":"b87f2bc59c9d0ee84915017543fe1ed187bab4bb8c5d0a58afa28482427d295b"} Jul 01 19:24:02.590061 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.590035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lcpjl" event={"ID":"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1","Type":"ContainerStarted","Data":"c8ca3d4e3e28e028a1fd026a2181a7a2cd0cddec7b2fd9ed00f1ec1df8dd7b0d"} Jul 01 19:24:02.621777 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:02.621723 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" podStartSLOduration=1.649276009 podStartE2EDuration="4.621703563s" totalImagesPullingTime="2.972427554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:02.620669757 +0000 UTC m=+66.766643498" watchObservedRunningTime="2026-07-01 19:24:02.621703563 +0000 UTC m=+66.767677305" Jul 01 19:24:03.132491 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.132458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:03.132934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.132591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:03.132934 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.132616 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:03.132934 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.132695 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:03.132934 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.132704 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:07.13268172 +0000 UTC m=+71.278655453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : configmap "kube-rbac-proxy" not found Jul 01 19:24:03.132934 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.132736 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:07.132725144 +0000 UTC m=+71.278698880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:03.462988 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.462909 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsq8v_25f29a38-ccf8-4aa5-8b88-7125295b8e6b/serve-healthcheck-canary/0.log" Jul 01 19:24:03.537356 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.537036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:24:03.537356 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.537178 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:24:03.537356 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.537243 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:11.537222159 +0000 UTC m=+75.683195899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:24:03.596133 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.595612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" event={"ID":"d06fa14d-c14f-486e-ac5e-9dbaeb496360","Type":"ContainerStarted","Data":"0b3c94d5e8fac8492ddb8f8c32bfb27bff7ddd30b15a6aaf02e9b60ea0072487"} Jul 01 19:24:03.638659 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.638128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:03.638659 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.638274 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 19:24:03.638659 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:03.638331 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls podName:e1970e54-c8a9-48ab-bb1a-22c7740071c7 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:35.638312266 +0000 UTC m=+99.784285996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls") pod "dns-default-fgjzg" (UID: "e1970e54-c8a9-48ab-bb1a-22c7740071c7") : secret "dns-default-metrics-tls" not found Jul 01 19:24:03.673790 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:03.671995 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" podStartSLOduration=1.300017951 podStartE2EDuration="3.671972463s" totalImagesPullingTime="2.371954512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:03.67179944 +0000 UTC m=+67.817773180" watchObservedRunningTime="2026-07-01 19:24:03.671972463 +0000 UTC m=+67.817946205" Jul 01 19:24:04.043407 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:04.043361 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:04.043613 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:04.043532 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:24:04.043613 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:04.043555 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:24:04.043730 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:04.043619 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:24:12.043598678 +0000 UTC m=+76.189572415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:24:07.171255 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.171212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:07.171255 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.171271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:07.171768 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.171376 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:07.171768 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.171408 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 19:24:07.171768 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.171466 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.171446866 +0000 UTC m=+79.317420602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : configmap "kube-rbac-proxy" not found Jul 01 19:24:07.171768 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.171487 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.171478862 +0000 UTC m=+79.317452582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:07.276108 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.276080 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd"] Jul 01 19:24:07.278489 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.278464 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.280801 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.280775 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 19:24:07.281111 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.281093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 19:24:07.281227 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.281120 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 19:24:07.285514 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.281893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 19:24:07.285514 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.282491 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d4tnr\"" Jul 01 19:24:07.287870 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.287783 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd"] Jul 01 19:24:07.373482 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.373451 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-key\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.373635 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.373521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.373635 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.373622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7s92\" (UniqueName: \"kubernetes.io/projected/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-kube-api-access-r7s92\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.474766 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.474726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7s92\" (UniqueName: \"kubernetes.io/projected/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-kube-api-access-r7s92\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.474946 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.474798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-key\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.474946 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.474867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.475536 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.475509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.478111 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.478087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-signing-key\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.484311 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.484289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7s92\" (UniqueName: \"kubernetes.io/projected/049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f-kube-api-access-r7s92\") pod \"service-ca-7bb4f4bcc7-4wrjd\" (UID: \"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.590402 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.590372 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" Jul 01 19:24:07.635104 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.635077 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b"] Jul 01 19:24:07.638184 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.638161 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:07.640915 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.640774 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 19:24:07.641133 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.641113 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rxp29\"" Jul 01 19:24:07.641573 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.641375 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 19:24:07.648025 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.648004 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b"] Jul 01 19:24:07.676434 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.676401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:07.676587 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.676481 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34d67ecd-ea72-4364-bca0-52509eda3362-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:07.739842 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.739763 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd"] Jul 01 19:24:07.743352 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:07.743323 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049645fb_2acc_4cf4_a1eb_c1f4bd0dca5f.slice/crio-8e45d260e93aee2de69c05485b68f30cef56dd328e7e4b87dc299ace50bdbe3d WatchSource:0}: Error finding container 8e45d260e93aee2de69c05485b68f30cef56dd328e7e4b87dc299ace50bdbe3d: Status 404 returned error can't find the container with id 8e45d260e93aee2de69c05485b68f30cef56dd328e7e4b87dc299ace50bdbe3d Jul 01 19:24:07.777345 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.777318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:07.777438 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.777401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34d67ecd-ea72-4364-bca0-52509eda3362-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:07.777525 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.777503 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:24:07.777598 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:07.777587 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert podName:34d67ecd-ea72-4364-bca0-52509eda3362 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:08.277566024 +0000 UTC m=+72.423539763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-lpw6b" (UID: "34d67ecd-ea72-4364-bca0-52509eda3362") : secret "networking-console-plugin-cert" not found Jul 01 19:24:07.777975 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:07.777960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34d67ecd-ea72-4364-bca0-52509eda3362-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:08.281553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.281512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:08.281956 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:08.281653 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:24:08.281956 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:08.281723 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert podName:34d67ecd-ea72-4364-bca0-52509eda3362 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:09.281704408 +0000 UTC m=+73.427678127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-lpw6b" (UID: "34d67ecd-ea72-4364-bca0-52509eda3362") : secret "networking-console-plugin-cert" not found Jul 01 19:24:08.616354 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.616234 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lcpjl" event={"ID":"ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1","Type":"ContainerStarted","Data":"1b4555d7cd9c49edde539e51a97ea41d9c913b0a26090fd57e8874f4cc04f9ec"} Jul 01 19:24:08.617769 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.617708 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gczjd" event={"ID":"53a2443d-df99-41ac-bad6-27eeb7b3cdf6","Type":"ContainerStarted","Data":"c9dfe903b27fab0a187288c234e00b96c0dee6e82ae1770729414c2d69392c28"} Jul 01 19:24:08.617918 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.617774 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:24:08.619237 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.619210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" event={"ID":"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f","Type":"ContainerStarted","Data":"f5946d45b3092ff299ab9b79f4748c4622100cd5db7e69d2f5923291e7151c05"} Jul 01 19:24:08.619350 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.619248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" event={"ID":"049645fb-2acc-4cf4-a1eb-c1f4bd0dca5f","Type":"ContainerStarted","Data":"8e45d260e93aee2de69c05485b68f30cef56dd328e7e4b87dc299ace50bdbe3d"} Jul 01 19:24:08.633689 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.633651 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lcpjl" podStartSLOduration=67.560941549 podStartE2EDuration="1m12.633639247s" totalImagesPullingTime="5.072697698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:08.632766828 +0000 UTC m=+72.778740570" watchObservedRunningTime="2026-07-01 19:24:08.633639247 +0000 UTC m=+72.779612987" Jul 01 19:24:08.651090 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.651042 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gczjd" podStartSLOduration=67.602071428 podStartE2EDuration="1m12.65102719s" totalImagesPullingTime="5.048955762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:08.650724456 +0000 UTC m=+72.796698202" watchObservedRunningTime="2026-07-01 19:24:08.65102719 +0000 UTC m=+72.797000932" Jul 01 19:24:08.668738 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:08.668703 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-4wrjd" podStartSLOduration=1.668689678 podStartE2EDuration="1.668689678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:08.668442263 +0000 UTC m=+72.814416004" watchObservedRunningTime="2026-07-01 19:24:08.668689678 +0000 UTC m=+72.814663419" Jul 01 19:24:09.289959 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:09.289910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:09.290433 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:09.290070 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:24:09.290433 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:09.290138 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert podName:34d67ecd-ea72-4364-bca0-52509eda3362 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:11.290122747 +0000 UTC m=+75.436096466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-lpw6b" (UID: "34d67ecd-ea72-4364-bca0-52509eda3362") : secret "networking-console-plugin-cert" not found Jul 01 19:24:11.307654 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:11.307614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:11.308088 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:11.307745 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:24:11.308088 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:11.307815 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert podName:34d67ecd-ea72-4364-bca0-52509eda3362 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:15.30779917 +0000 UTC m=+79.453772908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-lpw6b" (UID: "34d67ecd-ea72-4364-bca0-52509eda3362") : secret "networking-console-plugin-cert" not found Jul 01 19:24:11.610898 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:11.610791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:24:11.611043 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:11.610968 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 19:24:11.611043 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:11.611029 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls podName:23a58980-1db2-41a9-8f73-92e54d52b062 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:27.611015187 +0000 UTC m=+91.756988906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-cpc74" (UID: "23a58980-1db2-41a9-8f73-92e54d52b062") : secret "cluster-monitoring-operator-tls" not found Jul 01 19:24:12.114993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:12.114953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") pod \"image-registry-59447d84d5-r24cd\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:12.115186 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:12.115070 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 19:24:12.115186 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:12.115081 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59447d84d5-r24cd: secret "image-registry-tls" not found Jul 01 19:24:12.115186 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:12.115139 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls podName:5f32a5dd-af0e-4fe7-9013-b5487498fe4e nodeName:}" failed. No retries permitted until 2026-07-01 19:24:28.115126463 +0000 UTC m=+92.261100182 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls") pod "image-registry-59447d84d5-r24cd" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e") : secret "image-registry-tls" not found Jul 01 19:24:15.241649 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:15.241607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:15.242094 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:15.241658 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:15.242094 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:15.241770 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 19:24:15.242094 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:15.241847 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls podName:4b752549-961e-49a0-b8c5-07a299dfa4b3 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:31.241829271 +0000 UTC m=+95.387803013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wzcv" (UID: "4b752549-961e-49a0-b8c5-07a299dfa4b3") : secret "insights-runtime-extractor-tls" not found Jul 01 19:24:15.242292 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:15.242274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b752549-961e-49a0-b8c5-07a299dfa4b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:15.342281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:15.342243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:15.342439 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:15.342367 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 19:24:15.342439 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:15.342420 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert podName:34d67ecd-ea72-4364-bca0-52509eda3362 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:23.342406739 +0000 UTC m=+87.488380457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-lpw6b" (UID: "34d67ecd-ea72-4364-bca0-52509eda3362") : secret "networking-console-plugin-cert" not found Jul 01 19:24:23.412189 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:23.412064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:23.414647 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:23.414620 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34d67ecd-ea72-4364-bca0-52509eda3362-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-lpw6b\" (UID: \"34d67ecd-ea72-4364-bca0-52509eda3362\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:23.548741 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:23.548706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" Jul 01 19:24:23.673348 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:23.673274 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b"] Jul 01 19:24:23.676165 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:23.676137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d67ecd_ea72_4364_bca0_52509eda3362.slice/crio-4a1921fe7f31be92d740fc89be247d99c29d15d0e6b139fe30dc8d7e39d212d8 WatchSource:0}: Error finding container 4a1921fe7f31be92d740fc89be247d99c29d15d0e6b139fe30dc8d7e39d212d8: Status 404 returned error can't find the container with id 4a1921fe7f31be92d740fc89be247d99c29d15d0e6b139fe30dc8d7e39d212d8 Jul 01 19:24:24.669169 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:24.669132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" event={"ID":"34d67ecd-ea72-4364-bca0-52509eda3362","Type":"ContainerStarted","Data":"4a1921fe7f31be92d740fc89be247d99c29d15d0e6b139fe30dc8d7e39d212d8"} Jul 01 19:24:25.674041 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:25.674007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" event={"ID":"34d67ecd-ea72-4364-bca0-52509eda3362","Type":"ContainerStarted","Data":"cf027ed2cf30ba21d36f6a1c9c784c8d134fb0839f31663a90d1a539a330897c"} Jul 01 19:24:25.690029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:25.689982 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-lpw6b" podStartSLOduration=17.485084581 podStartE2EDuration="18.689969223s" totalImagesPullingTime="1.204884642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:25.688999074 +0000 UTC m=+89.834972814" watchObservedRunningTime="2026-07-01 19:24:25.689969223 +0000 UTC m=+89.835942965" Jul 01 19:24:26.252559 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.252530 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-w4vgh"] Jul 01 19:24:26.255619 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.255598 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59447d84d5-r24cd"] Jul 01 19:24:26.255730 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.255707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:26.255849 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:26.255827 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-59447d84d5-r24cd" podUID="5f32a5dd-af0e-4fe7-9013-b5487498fe4e" Jul 01 19:24:26.259947 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.259923 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xd4bp\"" Jul 01 19:24:26.260059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.259968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 19:24:26.260059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.260030 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 19:24:26.267245 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.267225 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-w4vgh"] Jul 01 19:24:26.336944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.336914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxtr\" (UniqueName: \"kubernetes.io/projected/d7d98e41-7110-43e3-b4c4-2e52e19db929-kube-api-access-mqxtr\") pod \"downloads-5499b6fb8f-w4vgh\" (UID: \"d7d98e41-7110-43e3-b4c4-2e52e19db929\") " pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:26.439344 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.439154 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxtr\" (UniqueName: \"kubernetes.io/projected/d7d98e41-7110-43e3-b4c4-2e52e19db929-kube-api-access-mqxtr\") pod \"downloads-5499b6fb8f-w4vgh\" (UID: \"d7d98e41-7110-43e3-b4c4-2e52e19db929\") " pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:26.451015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.450969 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxtr\" (UniqueName: \"kubernetes.io/projected/d7d98e41-7110-43e3-b4c4-2e52e19db929-kube-api-access-mqxtr\") pod \"downloads-5499b6fb8f-w4vgh\" (UID: \"d7d98e41-7110-43e3-b4c4-2e52e19db929\") " pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:26.567037 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.566952 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:26.677491 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.677462 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:26.684541 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.684519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:26.693544 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.693522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-w4vgh"] Jul 01 19:24:26.696935 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:26.696911 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d98e41_7110_43e3_b4c4_2e52e19db929.slice/crio-d3bef754ed822896c47f6e897634095d6b8bf5f22639e514e26077c2573ed41a WatchSource:0}: Error finding container d3bef754ed822896c47f6e897634095d6b8bf5f22639e514e26077c2573ed41a: Status 404 returned error can't find the container with id d3bef754ed822896c47f6e897634095d6b8bf5f22639e514e26077c2573ed41a Jul 01 19:24:26.843024 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.842941 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843024 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843003 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843038 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdmgr\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843062 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843080 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843097 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843218 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843112 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets\") pod \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\" (UID: \"5f32a5dd-af0e-4fe7-9013-b5487498fe4e\") " Jul 01 19:24:26.843451 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843335 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:24:26.843451 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843373 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:26.843550 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843514 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-certificates\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.843550 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843542 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-ca-trust-extracted\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.843712 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.843672 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:24:26.845707 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.845685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr" (OuterVolumeSpecName: "kube-api-access-zdmgr") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "kube-api-access-zdmgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:26.845707 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.845690 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:26.845835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.845721 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:24:26.845835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.845748 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5f32a5dd-af0e-4fe7-9013-b5487498fe4e" (UID: "5f32a5dd-af0e-4fe7-9013-b5487498fe4e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:24:26.944650 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.944619 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-image-registry-private-configuration\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.944650 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.944644 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdmgr\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-kube-api-access-zdmgr\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.944650 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.944655 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-trusted-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.944856 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.944664 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-bound-sa-token\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:26.944856 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:26.944671 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-installation-pull-secrets\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:27.649940 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.649901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:24:27.652766 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.652737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/23a58980-1db2-41a9-8f73-92e54d52b062-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-cpc74\" (UID: \"23a58980-1db2-41a9-8f73-92e54d52b062\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:24:27.681893 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.681859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59447d84d5-r24cd" Jul 01 19:24:27.682238 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.681868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-w4vgh" event={"ID":"d7d98e41-7110-43e3-b4c4-2e52e19db929","Type":"ContainerStarted","Data":"d3bef754ed822896c47f6e897634095d6b8bf5f22639e514e26077c2573ed41a"} Jul 01 19:24:27.716394 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.716369 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59447d84d5-r24cd"] Jul 01 19:24:27.721022 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.721002 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59447d84d5-r24cd"] Jul 01 19:24:27.852028 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.851995 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5f32a5dd-af0e-4fe7-9013-b5487498fe4e-registry-tls\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:24:27.936904 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.936803 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w8cxg\"" Jul 01 19:24:27.945695 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:27.945677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" Jul 01 19:24:28.079639 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:28.079602 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74"] Jul 01 19:24:28.083196 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:28.083162 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a58980_1db2_41a9_8f73_92e54d52b062.slice/crio-42fb22705d2fea73d92553103aca1106f6fe8da4eb031e7b97a99fb88a8253fa WatchSource:0}: Error finding container 42fb22705d2fea73d92553103aca1106f6fe8da4eb031e7b97a99fb88a8253fa: Status 404 returned error can't find the container with id 42fb22705d2fea73d92553103aca1106f6fe8da4eb031e7b97a99fb88a8253fa Jul 01 19:24:28.289264 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:28.289229 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f32a5dd-af0e-4fe7-9013-b5487498fe4e" path="/var/lib/kubelet/pods/5f32a5dd-af0e-4fe7-9013-b5487498fe4e/volumes" Jul 01 19:24:28.686906 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:28.686804 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" event={"ID":"23a58980-1db2-41a9-8f73-92e54d52b062","Type":"ContainerStarted","Data":"42fb22705d2fea73d92553103aca1106f6fe8da4eb031e7b97a99fb88a8253fa"} Jul 01 19:24:30.552975 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.552938 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5"] Jul 01 19:24:30.556249 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.556222 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:30.558488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.558292 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 01 19:24:30.558488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.558403 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v7mq5\"" Jul 01 19:24:30.566803 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.566748 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5"] Jul 01 19:24:30.674721 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.674681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/622f5aa3-8ada-48f6-a817-15799895eb24-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-fhtp5\" (UID: \"622f5aa3-8ada-48f6-a817-15799895eb24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:30.696595 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.696548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" event={"ID":"23a58980-1db2-41a9-8f73-92e54d52b062","Type":"ContainerStarted","Data":"0ceca978161cf5464e70a9699488995e4e71a50351192e02e9f5866769b281bb"} Jul 01 19:24:30.714944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.714896 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-cpc74" podStartSLOduration=33.773835237 podStartE2EDuration="35.714866794s" totalImagesPullingTime="1.941031557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:30.713313177 +0000 UTC m=+94.859286944" watchObservedRunningTime="2026-07-01 19:24:30.714866794 +0000 UTC m=+94.860840534" Jul 01 19:24:30.775671 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.775632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/622f5aa3-8ada-48f6-a817-15799895eb24-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-fhtp5\" (UID: \"622f5aa3-8ada-48f6-a817-15799895eb24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:30.778745 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.778717 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/622f5aa3-8ada-48f6-a817-15799895eb24-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-fhtp5\" (UID: \"622f5aa3-8ada-48f6-a817-15799895eb24\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:30.868539 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:30.868443 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:31.045424 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.045394 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5"] Jul 01 19:24:31.048923 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:31.048864 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622f5aa3_8ada_48f6_a817_15799895eb24.slice/crio-b603a78961df0c55096c864850a523b6cbca39b2602299309e81b4bd83c55ade WatchSource:0}: Error finding container b603a78961df0c55096c864850a523b6cbca39b2602299309e81b4bd83c55ade: Status 404 returned error can't find the container with id b603a78961df0c55096c864850a523b6cbca39b2602299309e81b4bd83c55ade Jul 01 19:24:31.281105 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.281072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:31.283922 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.283895 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b752549-961e-49a0-b8c5-07a299dfa4b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wzcv\" (UID: \"4b752549-961e-49a0-b8c5-07a299dfa4b3\") " pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:31.555098 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.555018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wzcv" Jul 01 19:24:31.702926 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.702830 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" event={"ID":"622f5aa3-8ada-48f6-a817-15799895eb24","Type":"ContainerStarted","Data":"b603a78961df0c55096c864850a523b6cbca39b2602299309e81b4bd83c55ade"} Jul 01 19:24:31.714580 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:31.713004 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wzcv"] Jul 01 19:24:31.716536 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:31.716507 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b752549_961e_49a0_b8c5_07a299dfa4b3.slice/crio-7b3805cd4c756f0d61db2bf7f375219244624412119041a36e97c590cf43c691 WatchSource:0}: Error finding container 7b3805cd4c756f0d61db2bf7f375219244624412119041a36e97c590cf43c691: Status 404 returned error can't find the container with id 7b3805cd4c756f0d61db2bf7f375219244624412119041a36e97c590cf43c691 Jul 01 19:24:32.709493 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:32.709458 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wzcv" event={"ID":"4b752549-961e-49a0-b8c5-07a299dfa4b3","Type":"ContainerStarted","Data":"7b3805cd4c756f0d61db2bf7f375219244624412119041a36e97c590cf43c691"} Jul 01 19:24:32.712237 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:32.712164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" event={"ID":"622f5aa3-8ada-48f6-a817-15799895eb24","Type":"ContainerStarted","Data":"f87ac788819827a3bd37e31c18b2a6a71b5e7316cda3eb914eff031e392f439f"} Jul 01 19:24:32.712675 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:32.712656 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:32.721220 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:32.721166 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" Jul 01 19:24:32.731134 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:32.730737 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-fhtp5" podStartSLOduration=1.605240778 podStartE2EDuration="2.730717669s" totalImagesPullingTime="1.125476891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:32.729165651 +0000 UTC m=+96.875139392" watchObservedRunningTime="2026-07-01 19:24:32.730717669 +0000 UTC m=+96.876691411" Jul 01 19:24:33.617316 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.617276 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-hjgrf"] Jul 01 19:24:33.624234 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.624209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.626845 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.626799 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 19:24:33.627386 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.627362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 19:24:33.627604 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.627589 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vjw6v\"" Jul 01 19:24:33.628431 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.628409 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 19:24:33.645630 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.645560 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-hjgrf"] Jul 01 19:24:33.802970 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.802923 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.803423 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.803050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef31ae-d08a-4e31-bd25-644f261adfec-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.803423 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.803106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.803423 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.803172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btdkq\" (UniqueName: \"kubernetes.io/projected/c2ef31ae-d08a-4e31-bd25-644f261adfec-kube-api-access-btdkq\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.904206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.904296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef31ae-d08a-4e31-bd25-644f261adfec-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.904351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.904395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btdkq\" (UniqueName: \"kubernetes.io/projected/c2ef31ae-d08a-4e31-bd25-644f261adfec-kube-api-access-btdkq\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:33.904722 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 01 19:24:33.904797 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:33.904785 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls podName:c2ef31ae-d08a-4e31-bd25-644f261adfec nodeName:}" failed. No retries permitted until 2026-07-01 19:24:34.404766079 +0000 UTC m=+98.550739809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-hjgrf" (UID: "c2ef31ae-d08a-4e31-bd25-644f261adfec") : secret "prometheus-operator-tls" not found Jul 01 19:24:33.905241 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.905098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2ef31ae-d08a-4e31-bd25-644f261adfec-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.915062 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.909670 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:33.916311 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:33.916265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btdkq\" (UniqueName: \"kubernetes.io/projected/c2ef31ae-d08a-4e31-bd25-644f261adfec-kube-api-access-btdkq\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:34.408985 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:34.408948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:34.411912 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:34.411868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c2ef31ae-d08a-4e31-bd25-644f261adfec-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-hjgrf\" (UID: \"c2ef31ae-d08a-4e31-bd25-644f261adfec\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:34.537307 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:34.537263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" Jul 01 19:24:35.721179 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:35.721143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:35.724033 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:35.724006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1970e54-c8a9-48ab-bb1a-22c7740071c7-metrics-tls\") pod \"dns-default-fgjzg\" (UID: \"e1970e54-c8a9-48ab-bb1a-22c7740071c7\") " pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:35.985007 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:35.984926 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2b6mr\"" Jul 01 19:24:35.992951 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:35.992916 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:36.384390 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:36.384352 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-hjgrf"] Jul 01 19:24:36.398155 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:36.398127 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fgjzg"] Jul 01 19:24:36.554569 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:36.554481 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ef31ae_d08a_4e31_bd25_644f261adfec.slice/crio-364a6d4c73885ac7c0bd4a6e8e7549230e2223928ff900227ec75a3974207e18 WatchSource:0}: Error finding container 364a6d4c73885ac7c0bd4a6e8e7549230e2223928ff900227ec75a3974207e18: Status 404 returned error can't find the container with id 364a6d4c73885ac7c0bd4a6e8e7549230e2223928ff900227ec75a3974207e18 Jul 01 19:24:36.555445 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:36.555392 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1970e54_c8a9_48ab_bb1a_22c7740071c7.slice/crio-eefc5923150a2e14cb2a890c2ef6fef595aaf20e525488301954071e8f6b4e7d WatchSource:0}: Error finding container eefc5923150a2e14cb2a890c2ef6fef595aaf20e525488301954071e8f6b4e7d: Status 404 returned error can't find the container with id eefc5923150a2e14cb2a890c2ef6fef595aaf20e525488301954071e8f6b4e7d Jul 01 19:24:36.734504 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:36.734434 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wzcv" event={"ID":"4b752549-961e-49a0-b8c5-07a299dfa4b3","Type":"ContainerStarted","Data":"b378fd3954b11048534c7520d7aa3bb5dfd6f84bf124d34c6cba3217b75edd4f"} Jul 01 19:24:36.735937 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:36.735908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fgjzg" event={"ID":"e1970e54-c8a9-48ab-bb1a-22c7740071c7","Type":"ContainerStarted","Data":"eefc5923150a2e14cb2a890c2ef6fef595aaf20e525488301954071e8f6b4e7d"} Jul 01 19:24:36.737217 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:36.737195 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" event={"ID":"c2ef31ae-d08a-4e31-bd25-644f261adfec","Type":"ContainerStarted","Data":"364a6d4c73885ac7c0bd4a6e8e7549230e2223928ff900227ec75a3974207e18"} Jul 01 19:24:37.081046 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.081007 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:24:37.094373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.094327 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:24:37.094505 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.094429 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.097013 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.096858 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 19:24:37.097518 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.097497 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vq2mg\"" Jul 01 19:24:37.097756 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.097740 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 19:24:37.098085 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.098062 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 19:24:37.098230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.098126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 19:24:37.098230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.098065 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134236 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134269 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl2r5\" (UniqueName: \"kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.134443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.134340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240242 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240486 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl2r5\" (UniqueName: \"kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240619 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240619 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240537 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240619 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.240769 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.240661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.241577 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.241547 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.241685 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.241633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.241912 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.241893 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.243629 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.243605 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.243844 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.243824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.249699 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.249675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl2r5\" (UniqueName: \"kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5\") pod \"console-7974d894fb-fvc66\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.407313 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.407235 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:37.592359 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:37.592280 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:24:38.745972 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:38.745933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974d894fb-fvc66" event={"ID":"2a9808d8-c432-4ebd-b746-eaf169e576f2","Type":"ContainerStarted","Data":"808f5655cf4893ae049d1a416eb40a6a51a23702f07caa5e53fe177eb5251e14"} Jul 01 19:24:39.625525 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:39.625424 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gczjd" Jul 01 19:24:42.085574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.085535 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:24:42.088553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.088533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.100025 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.100000 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 19:24:42.106036 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.106014 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:24:42.183711 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.183917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.183917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnbj\" (UniqueName: \"kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.183917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.183917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.184103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.184103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.183986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.284944 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.284902 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285136 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285013 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285136 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnbj\" (UniqueName: \"kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285136 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285292 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285292 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285172 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285292 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285194 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285849 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.285849 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.285817 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.286131 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.286042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.286454 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.286427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.288006 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.287985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.288230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.288210 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.293814 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.293791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnbj\" (UniqueName: \"kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj\") pod \"console-6c5b76f988-wcdnd\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:42.403278 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:42.403196 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:47.319406 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.317911 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:24:47.785111 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.785066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" event={"ID":"c2ef31ae-d08a-4e31-bd25-644f261adfec","Type":"ContainerStarted","Data":"f099c340d621f10cd1bfbfabc4c39a44234f3dd50cb1f25238eb4fe02014f8aa"} Jul 01 19:24:47.785309 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.785141 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" event={"ID":"c2ef31ae-d08a-4e31-bd25-644f261adfec","Type":"ContainerStarted","Data":"3414c0f140ba509d62d06586ead4a4a927deda2facaddc696a00e5a97f06c80b"} Jul 01 19:24:47.788090 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.787980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-w4vgh" event={"ID":"d7d98e41-7110-43e3-b4c4-2e52e19db929","Type":"ContainerStarted","Data":"57a33f693919618ef7bdfc9d035d9ae914c542e025d5eb603b5df30c744b818f"} Jul 01 19:24:47.788713 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.788691 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:47.792299 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.792274 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wzcv" event={"ID":"4b752549-961e-49a0-b8c5-07a299dfa4b3","Type":"ContainerStarted","Data":"349bf708d8cddd1a6e407e6db5fd65129e3824e1b718e6f5c646bab755e2eb9d"} Jul 01 19:24:47.794565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.794517 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fgjzg" event={"ID":"e1970e54-c8a9-48ab-bb1a-22c7740071c7","Type":"ContainerStarted","Data":"57e11c13d4e11b1b43945954b90b01c9f4d08b7703c37c0bc436e5d8dcba7cf5"} Jul 01 19:24:47.794723 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.794706 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fgjzg" event={"ID":"e1970e54-c8a9-48ab-bb1a-22c7740071c7","Type":"ContainerStarted","Data":"9437af52d3cbf873d5613eef47098502f02d6ec34c1284e8e26e93034a32d6d7"} Jul 01 19:24:47.794844 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.794832 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:47.797376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.797348 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974d894fb-fvc66" event={"ID":"2a9808d8-c432-4ebd-b746-eaf169e576f2","Type":"ContainerStarted","Data":"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3"} Jul 01 19:24:47.799908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.799714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5b76f988-wcdnd" event={"ID":"5a70d781-e13c-4243-9686-bd50bda31a7f","Type":"ContainerStarted","Data":"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9"} Jul 01 19:24:47.799908 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.799748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5b76f988-wcdnd" event={"ID":"5a70d781-e13c-4243-9686-bd50bda31a7f","Type":"ContainerStarted","Data":"fae6f8ce1f396d0d63471484623bbe89acac69f184422c6cad17f0002f2f5b55"} Jul 01 19:24:47.802723 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.802703 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-w4vgh" Jul 01 19:24:47.804945 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.804890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-hjgrf" podStartSLOduration=4.222494426 podStartE2EDuration="14.804859039s" totalImagesPullingTime="10.582364613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.80445323 +0000 UTC m=+111.950426982" watchObservedRunningTime="2026-07-01 19:24:47.804859039 +0000 UTC m=+111.950832780" Jul 01 19:24:47.822820 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.822763 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fgjzg" podStartSLOduration=66.240487639 podStartE2EDuration="1m16.822748765s" totalImagesPullingTime="10.582261126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.821210844 +0000 UTC m=+111.967184586" watchObservedRunningTime="2026-07-01 19:24:47.822748765 +0000 UTC m=+111.968722503" Jul 01 19:24:47.839837 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.839790 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-w4vgh" podStartSLOduration=1.380346749 podStartE2EDuration="21.83977413s" totalImagesPullingTime="20.459427381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.838927852 +0000 UTC m=+111.984901616" watchObservedRunningTime="2026-07-01 19:24:47.83977413 +0000 UTC m=+111.985747881" Jul 01 19:24:47.868273 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.868224 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7974d894fb-fvc66" podStartSLOduration=1.454575482 podStartE2EDuration="10.868203249s" totalImagesPullingTime="9.413627767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.867130605 +0000 UTC m=+112.013104346" watchObservedRunningTime="2026-07-01 19:24:47.868203249 +0000 UTC m=+112.014176992" Jul 01 19:24:47.886770 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:47.886695 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c5b76f988-wcdnd" podStartSLOduration=5.886674288 podStartE2EDuration="5.886674288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:47.884657955 +0000 UTC m=+112.030631708" watchObservedRunningTime="2026-07-01 19:24:47.886674288 +0000 UTC m=+112.032648031" Jul 01 19:24:49.957898 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:49.957268 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r"] Jul 01 19:24:50.030652 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.030609 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r"] Jul 01 19:24:50.030819 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.030670 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8wdqq"] Jul 01 19:24:50.030819 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.030713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.035620 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.034978 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-79zvx\"" Jul 01 19:24:50.035620 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.035152 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 19:24:50.035620 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.035411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 19:24:50.069446 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.068287 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.070975 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.070950 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdcln\"" Jul 01 19:24:50.071580 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.071167 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 19:24:50.071580 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.071434 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 19:24:50.074336 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.074186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-wtmp\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163263 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-textfile\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d7ph\" (UniqueName: \"kubernetes.io/projected/f5fd2253-4915-427e-8eac-9dbff4acdfc4-kube-api-access-9d7ph\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd01cc65-339f-4973-96ac-364303923f6f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-metrics-client-ca\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqc8v\" (UniqueName: \"kubernetes.io/projected/fd01cc65-339f-4973-96ac-364303923f6f-kube-api-access-mqc8v\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-sys\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.163902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.163639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-root\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-wtmp\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-textfile\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d7ph\" (UniqueName: \"kubernetes.io/projected/f5fd2253-4915-427e-8eac-9dbff4acdfc4-kube-api-access-9d7ph\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd01cc65-339f-4973-96ac-364303923f6f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-metrics-client-ca\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.265029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.264988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqc8v\" (UniqueName: \"kubernetes.io/projected/fd01cc65-339f-4973-96ac-364303923f6f-kube-api-access-mqc8v\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-sys\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-root\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-root\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.265988 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-wtmp\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266736 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.266450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.266924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.266904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fd2253-4915-427e-8eac-9dbff4acdfc4-metrics-client-ca\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.268443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.267250 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5fd2253-4915-427e-8eac-9dbff4acdfc4-sys\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.268443 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:50.267689 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 19:24:50.268443 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:24:50.267749 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls podName:f5fd2253-4915-427e-8eac-9dbff4acdfc4 nodeName:}" failed. No retries permitted until 2026-07-01 19:24:50.767730094 +0000 UTC m=+114.913703814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls") pod "node-exporter-8wdqq" (UID: "f5fd2253-4915-427e-8eac-9dbff4acdfc4") : secret "node-exporter-tls" not found Jul 01 19:24:50.268443 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.268393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-textfile\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.269595 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.269574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd01cc65-339f-4973-96ac-364303923f6f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.270452 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.270410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.277449 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.277396 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.280349 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.280294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd01cc65-339f-4973-96ac-364303923f6f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.295594 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.295540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqc8v\" (UniqueName: \"kubernetes.io/projected/fd01cc65-339f-4973-96ac-364303923f6f-kube-api-access-mqc8v\") pod \"openshift-state-metrics-57f99c8b49-rnw8r\" (UID: \"fd01cc65-339f-4973-96ac-364303923f6f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.297224 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.297159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d7ph\" (UniqueName: \"kubernetes.io/projected/f5fd2253-4915-427e-8eac-9dbff4acdfc4-kube-api-access-9d7ph\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.345369 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.345138 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" Jul 01 19:24:50.773981 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.773865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.776976 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.776951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5fd2253-4915-427e-8eac-9dbff4acdfc4-node-exporter-tls\") pod \"node-exporter-8wdqq\" (UID: \"f5fd2253-4915-427e-8eac-9dbff4acdfc4\") " pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:50.919732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.919575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r"] Jul 01 19:24:50.984289 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:50.984250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8wdqq" Jul 01 19:24:51.089375 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:51.089347 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5fd2253_4915_427e_8eac_9dbff4acdfc4.slice/crio-e354cb3aa80033f7c09a8b0977d2f16d6023d61d7dc61d76e1682eb826af02fc WatchSource:0}: Error finding container e354cb3aa80033f7c09a8b0977d2f16d6023d61d7dc61d76e1682eb826af02fc: Status 404 returned error can't find the container with id e354cb3aa80033f7c09a8b0977d2f16d6023d61d7dc61d76e1682eb826af02fc Jul 01 19:24:51.832036 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.831951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wzcv" event={"ID":"4b752549-961e-49a0-b8c5-07a299dfa4b3","Type":"ContainerStarted","Data":"29899e6a29bec2c4f3e305d66b8a98991274a0c0067ce1afd9e6191840916392"} Jul 01 19:24:51.833912 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.833859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wdqq" event={"ID":"f5fd2253-4915-427e-8eac-9dbff4acdfc4","Type":"ContainerStarted","Data":"e354cb3aa80033f7c09a8b0977d2f16d6023d61d7dc61d76e1682eb826af02fc"} Jul 01 19:24:51.837590 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.837563 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" event={"ID":"fd01cc65-339f-4973-96ac-364303923f6f","Type":"ContainerStarted","Data":"de0916c81b55f460df9b8f46db5cda3ea7d98aaecc6b74b56ac9d168b4c35451"} Jul 01 19:24:51.837706 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.837624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" event={"ID":"fd01cc65-339f-4973-96ac-364303923f6f","Type":"ContainerStarted","Data":"ba82d95082335fcdaca9306c44420b6c4c4ec0f47aa7ccc19396b65e9553d018"} Jul 01 19:24:51.837706 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.837655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" event={"ID":"fd01cc65-339f-4973-96ac-364303923f6f","Type":"ContainerStarted","Data":"6ce64dc27ae7c6860a2ef792c965e7a264b667d3bed185db254069feff1d93d0"} Jul 01 19:24:51.855200 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.854999 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2wzcv" podStartSLOduration=34.761284595 podStartE2EDuration="52.854981627s" totalImagesPullingTime="18.093697032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:23:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:51.853978436 +0000 UTC m=+115.999952181" watchObservedRunningTime="2026-07-01 19:24:51.854981627 +0000 UTC m=+116.000955367" Jul 01 19:24:51.994270 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:51.994193 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-796b799fd7-hvmdq"] Jul 01 19:24:52.018950 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.017752 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-796b799fd7-hvmdq"] Jul 01 19:24:52.018950 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.017998 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.022949 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.022909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 19:24:52.023575 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.023555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 19:24:52.024053 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.023760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 19:24:52.024053 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.023994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-57om4943s9ogq\"" Jul 01 19:24:52.024189 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.024174 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z48lb\"" Jul 01 19:24:52.024371 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.024344 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 19:24:52.025415 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.025391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 19:24:52.085952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.085758 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.085952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.085838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xnvv\" (UniqueName: \"kubernetes.io/projected/188a89fe-ebfb-4f19-9076-f57548f3eb27-kube-api-access-8xnvv\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086270 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-grpc-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188a89fe-ebfb-4f19-9076-f57548f3eb27-metrics-client-ca\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.086596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.086475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188792 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xnvv\" (UniqueName: \"kubernetes.io/projected/188a89fe-ebfb-4f19-9076-f57548f3eb27-kube-api-access-8xnvv\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-grpc-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188962 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188a89fe-ebfb-4f19-9076-f57548f3eb27-metrics-client-ca\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.188998 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.188988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.189258 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.189040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.189258 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.189073 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.192066 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.192009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/188a89fe-ebfb-4f19-9076-f57548f3eb27-metrics-client-ca\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.196057 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.195974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-grpc-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.198142 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.198093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-tls\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.198376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.198353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.202395 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.202365 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.204242 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.204211 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.209313 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.209251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/188a89fe-ebfb-4f19-9076-f57548f3eb27-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.211247 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.211193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xnvv\" (UniqueName: \"kubernetes.io/projected/188a89fe-ebfb-4f19-9076-f57548f3eb27-kube-api-access-8xnvv\") pod \"thanos-querier-796b799fd7-hvmdq\" (UID: \"188a89fe-ebfb-4f19-9076-f57548f3eb27\") " pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.334993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.334957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:52.404119 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.404084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:52.404281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.404147 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:52.409651 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.409626 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:52.846905 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.846850 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:24:52.899895 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:52.899844 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:24:53.223340 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:53.223306 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-796b799fd7-hvmdq"] Jul 01 19:24:53.233230 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:53.233187 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188a89fe_ebfb_4f19_9076_f57548f3eb27.slice/crio-773dce552f8e201cd741e036d99cc104da6c18e688a474e895070092122e404c WatchSource:0}: Error finding container 773dce552f8e201cd741e036d99cc104da6c18e688a474e895070092122e404c: Status 404 returned error can't find the container with id 773dce552f8e201cd741e036d99cc104da6c18e688a474e895070092122e404c Jul 01 19:24:53.850704 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:53.850668 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5fd2253-4915-427e-8eac-9dbff4acdfc4" containerID="a9b6c51a42f30f23331df7832cdb3a7d86929e49ddada35ba6c96ac7700b7983" exitCode=0 Jul 01 19:24:53.851073 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:53.850775 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wdqq" event={"ID":"f5fd2253-4915-427e-8eac-9dbff4acdfc4","Type":"ContainerDied","Data":"a9b6c51a42f30f23331df7832cdb3a7d86929e49ddada35ba6c96ac7700b7983"} Jul 01 19:24:53.855231 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:53.855198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" event={"ID":"fd01cc65-339f-4973-96ac-364303923f6f","Type":"ContainerStarted","Data":"6037005299e81f8f7c1526679aa089b291b16703f4fe1dbdfcf51392861a2d4f"} Jul 01 19:24:53.856946 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:53.856916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"773dce552f8e201cd741e036d99cc104da6c18e688a474e895070092122e404c"} Jul 01 19:24:54.299809 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.299543 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-rnw8r" podStartSLOduration=3.647835916 podStartE2EDuration="5.299520564s" totalImagesPullingTime="1.651684648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:53.894977123 +0000 UTC m=+118.040950865" watchObservedRunningTime="2026-07-01 19:24:54.299520564 +0000 UTC m=+118.445494307" Jul 01 19:24:54.300728 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.300496 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-784b76946-pc5n2"] Jul 01 19:24:54.319649 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.319609 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-784b76946-pc5n2"] Jul 01 19:24:54.319789 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.319731 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.322350 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.322325 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9v7db\"" Jul 01 19:24:54.322569 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.322549 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 19:24:54.322764 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.322747 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 19:24:54.323570 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.323034 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 19:24:54.323570 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.323236 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3nbgjdvu2rvmh\"" Jul 01 19:24:54.323570 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.323419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 19:24:54.417942 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.417908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ecdb0e88-8c98-4e6c-b137-cdb343138d82-audit-log\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.417942 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.417942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbpr\" (UniqueName: \"kubernetes.io/projected/ecdb0e88-8c98-4e6c-b137-cdb343138d82-kube-api-access-dfbpr\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.418274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.418044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.418274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.418074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-tls\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.418274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.418124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-client-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.418274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.418187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-metrics-server-audit-profiles\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.418274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.418250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-client-certs\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519495 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519458 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ecdb0e88-8c98-4e6c-b137-cdb343138d82-audit-log\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbpr\" (UniqueName: \"kubernetes.io/projected/ecdb0e88-8c98-4e6c-b137-cdb343138d82-kube-api-access-dfbpr\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-tls\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519650 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-client-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-metrics-server-audit-profiles\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.519749 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.519726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-client-certs\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.521990 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.521340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ecdb0e88-8c98-4e6c-b137-cdb343138d82-audit-log\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.523855 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.523338 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-metrics-server-audit-profiles\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.523855 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.523635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdb0e88-8c98-4e6c-b137-cdb343138d82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.530062 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.524357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-client-certs\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.530062 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.526590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-client-ca-bundle\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.535521 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.535496 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ecdb0e88-8c98-4e6c-b137-cdb343138d82-secret-metrics-server-tls\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.543234 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.543101 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbpr\" (UniqueName: \"kubernetes.io/projected/ecdb0e88-8c98-4e6c-b137-cdb343138d82-kube-api-access-dfbpr\") pod \"metrics-server-784b76946-pc5n2\" (UID: \"ecdb0e88-8c98-4e6c-b137-cdb343138d82\") " pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.635712 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.635608 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:24:54.867025 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.866990 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wdqq" event={"ID":"f5fd2253-4915-427e-8eac-9dbff4acdfc4","Type":"ContainerStarted","Data":"5da958865a8a525dac354d9a75d197e3f7bcc91a8ac780dfed8c63f5314c6c06"} Jul 01 19:24:54.867249 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.867051 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8wdqq" event={"ID":"f5fd2253-4915-427e-8eac-9dbff4acdfc4","Type":"ContainerStarted","Data":"a9ac11f8219374021e2ee747866c894c45b144615644b7e2bed819cd0029a29a"} Jul 01 19:24:54.874341 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.874325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-784b76946-pc5n2"] Jul 01 19:24:54.877124 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:54.877096 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdb0e88_8c98_4e6c_b137_cdb343138d82.slice/crio-79ebff99cb05c6afc794fd83738a73180d203cdbca33679fc78ed167ff0a560d WatchSource:0}: Error finding container 79ebff99cb05c6afc794fd83738a73180d203cdbca33679fc78ed167ff0a560d: Status 404 returned error can't find the container with id 79ebff99cb05c6afc794fd83738a73180d203cdbca33679fc78ed167ff0a560d Jul 01 19:24:54.893291 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:54.893215 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8wdqq" podStartSLOduration=3.845246553 podStartE2EDuration="5.89319846s" totalImagesPullingTime="1.93857613s" totalInitContainerRuntime="109.375777ms" isStatefulPod=true podCreationTimestamp="2026-07-01 19:24:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:54.89152209 +0000 UTC m=+119.037495834" watchObservedRunningTime="2026-07-01 19:24:54.89319846 +0000 UTC m=+119.039172202" Jul 01 19:24:55.259535 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.259418 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fdd86d45c-m8c42"] Jul 01 19:24:55.288257 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.288224 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fdd86d45c-m8c42"] Jul 01 19:24:55.288449 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.288385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.294113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.293556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 01 19:24:55.294113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.293800 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pcnbl\"" Jul 01 19:24:55.294113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.294003 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 01 19:24:55.295917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.294567 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 01 19:24:55.295917 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.294758 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 01 19:24:55.299317 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.299299 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 01 19:24:55.302109 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.302093 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 01 19:24:55.431553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.431751 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-metrics-client-ca\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.431751 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbvq4\" (UniqueName: \"kubernetes.io/projected/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-kube-api-access-nbvq4\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.431751 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.431963 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-serving-certs-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.431963 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.431940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.432066 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.432020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.432118 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.432067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-federate-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.533581 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-serving-certs-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.533581 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.533581 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533573 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.534403 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533614 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-federate-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.534403 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.534403 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-metrics-client-ca\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.534403 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbvq4\" (UniqueName: \"kubernetes.io/projected/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-kube-api-access-nbvq4\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.534403 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.533817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.535287 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.535255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-metrics-client-ca\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.536202 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.536176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-serving-certs-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.536641 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.536596 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.537706 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.537684 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-federate-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.540497 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.540473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-telemeter-client-tls\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.542388 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.542357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.542640 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.542612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.543441 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.543415 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbvq4\" (UniqueName: \"kubernetes.io/projected/c07c1354-9037-4a2b-8fc8-6adcdc62f72c-kube-api-access-nbvq4\") pod \"telemeter-client-fdd86d45c-m8c42\" (UID: \"c07c1354-9037-4a2b-8fc8-6adcdc62f72c\") " pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.604788 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.604748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" Jul 01 19:24:55.882491 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:55.882395 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" event={"ID":"ecdb0e88-8c98-4e6c-b137-cdb343138d82","Type":"ContainerStarted","Data":"79ebff99cb05c6afc794fd83738a73180d203cdbca33679fc78ed167ff0a560d"} Jul 01 19:24:56.007425 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:56.007340 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fdd86d45c-m8c42"] Jul 01 19:24:56.143917 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:24:56.143825 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07c1354_9037_4a2b_8fc8_6adcdc62f72c.slice/crio-240a4992eaddec54c6bec3bc04d92f041d8ae2cdc47e7e229871dd8174af6a84 WatchSource:0}: Error finding container 240a4992eaddec54c6bec3bc04d92f041d8ae2cdc47e7e229871dd8174af6a84: Status 404 returned error can't find the container with id 240a4992eaddec54c6bec3bc04d92f041d8ae2cdc47e7e229871dd8174af6a84 Jul 01 19:24:56.889605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:56.889567 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"9d01c6448e9bbdcded0c278d94750fdb95b2368e0d50c90983e5278fa1fa23fb"} Jul 01 19:24:56.890178 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:56.889656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"0e32daa7537ddd5f4071634dc7fa2a275050a0dc7f7d9bddabbbf43fb1893b3e"} Jul 01 19:24:56.890178 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:56.889703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"b16eaa62313a33211eb4bdc8f90144a3cd90c2ad8762fb29e093cac61c115af9"} Jul 01 19:24:56.890896 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:56.890844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" event={"ID":"c07c1354-9037-4a2b-8fc8-6adcdc62f72c","Type":"ContainerStarted","Data":"240a4992eaddec54c6bec3bc04d92f041d8ae2cdc47e7e229871dd8174af6a84"} Jul 01 19:24:57.408025 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:57.407988 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:24:57.807986 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:57.807957 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fgjzg" Jul 01 19:24:59.909575 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.909532 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"55e82923b3b8c507c7784121de98b36c79a938b8ea9f64662117078bcea14f1c"} Jul 01 19:24:59.910175 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.909618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"9374ee8e4c8f6310bdb939db794a19ee82ac28d650926b170ab57bc72a51b048"} Jul 01 19:24:59.910175 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.909664 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:24:59.910175 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.909699 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" event={"ID":"188a89fe-ebfb-4f19-9076-f57548f3eb27","Type":"ContainerStarted","Data":"ffc455707745ed37236e79975080789a2dabea71104c72fe7ce2c286e98f67ab"} Jul 01 19:24:59.911243 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.911214 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" event={"ID":"c07c1354-9037-4a2b-8fc8-6adcdc62f72c","Type":"ContainerStarted","Data":"e754c0b88002de37d4b91b2f623bfe2cc8bd2cd525a2c41b7cec0a9eba9a7d61"} Jul 01 19:24:59.912790 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.912762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" event={"ID":"ecdb0e88-8c98-4e6c-b137-cdb343138d82","Type":"ContainerStarted","Data":"fd54a32097dded8855dfd3796441c030a80fc07b108d5aa2316954c8d082cd75"} Jul 01 19:24:59.938316 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.938267 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" podStartSLOduration=3.708807523 podStartE2EDuration="8.938247103s" totalImagesPullingTime="5.22943958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:59.93620271 +0000 UTC m=+124.082176474" watchObservedRunningTime="2026-07-01 19:24:59.938247103 +0000 UTC m=+124.084220846" Jul 01 19:24:59.954508 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:24:59.954449 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" podStartSLOduration=2.040649028 podStartE2EDuration="5.95443085s" totalImagesPullingTime="3.913781822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:24:59.953028078 +0000 UTC m=+124.099001830" watchObservedRunningTime="2026-07-01 19:24:59.95443085 +0000 UTC m=+124.100404593" Jul 01 19:25:00.919213 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:00.919167 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" event={"ID":"c07c1354-9037-4a2b-8fc8-6adcdc62f72c","Type":"ContainerStarted","Data":"4a566dab181f9ecc52824bb67f5793b0489847cd27f5bb3aa274439be6505a61"} Jul 01 19:25:00.919616 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:00.919282 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" event={"ID":"c07c1354-9037-4a2b-8fc8-6adcdc62f72c","Type":"ContainerStarted","Data":"7a23bd99be52c5d72102574637ba6f9d53f698775d31a91443961c2bd7834231"} Jul 01 19:25:00.943365 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:00.943317 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fdd86d45c-m8c42" podStartSLOduration=1.789137486 podStartE2EDuration="5.9433013s" totalImagesPullingTime="4.154163814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:24:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:00.941144706 +0000 UTC m=+125.087118446" watchObservedRunningTime="2026-07-01 19:25:00.9433013 +0000 UTC m=+125.089275040" Jul 01 19:25:01.868457 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.868423 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:25:01.893006 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.892968 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:25:01.893159 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.893094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.998575 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zm2v\" (UniqueName: \"kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:01.999010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:01.998809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.100055 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.100255 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zm2v\" (UniqueName: \"kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.100255 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.100389 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100263 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.100389 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100310 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101050 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101050 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.100744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101212 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.101106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101212 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.101106 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101433 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.101407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.101508 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.101491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.103334 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.103313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.103425 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.103339 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.109634 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.109583 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zm2v\" (UniqueName: \"kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v\") pod \"console-7bdc845b5f-bdfbg\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.203359 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.203278 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:02.365640 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.365609 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:25:02.368751 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:25:02.368721 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45719c7e_9b0d_414d_9f8c_651247911d69.slice/crio-6f6ca21b0c203bceb032928a9b43ed39068db2f6dde41d8eae83d7d7579a36c5 WatchSource:0}: Error finding container 6f6ca21b0c203bceb032928a9b43ed39068db2f6dde41d8eae83d7d7579a36c5: Status 404 returned error can't find the container with id 6f6ca21b0c203bceb032928a9b43ed39068db2f6dde41d8eae83d7d7579a36c5 Jul 01 19:25:02.928906 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.928799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc845b5f-bdfbg" event={"ID":"45719c7e-9b0d-414d-9f8c-651247911d69","Type":"ContainerStarted","Data":"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d"} Jul 01 19:25:02.928906 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.928857 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc845b5f-bdfbg" event={"ID":"45719c7e-9b0d-414d-9f8c-651247911d69","Type":"ContainerStarted","Data":"6f6ca21b0c203bceb032928a9b43ed39068db2f6dde41d8eae83d7d7579a36c5"} Jul 01 19:25:02.947227 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:02.947181 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdc845b5f-bdfbg" podStartSLOduration=1.9471660229999999 podStartE2EDuration="1.947166023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:02.946634768 +0000 UTC m=+127.092608510" watchObservedRunningTime="2026-07-01 19:25:02.947166023 +0000 UTC m=+127.093139765" Jul 01 19:25:05.926082 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:05.926052 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-796b799fd7-hvmdq" Jul 01 19:25:06.144373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.144338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:25:06.146872 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.146842 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3327b66-7666-4066-9d83-8af7c759a53f-metrics-certs\") pod \"network-metrics-daemon-bt4tw\" (UID: \"c3327b66-7666-4066-9d83-8af7c759a53f\") " pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:25:06.197082 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.196994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqcw7\"" Jul 01 19:25:06.204863 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.204840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bt4tw" Jul 01 19:25:06.383248 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.383222 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bt4tw"] Jul 01 19:25:06.384592 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:25:06.384567 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3327b66_7666_4066_9d83_8af7c759a53f.slice/crio-6b0e4c22c5c56d4b06bbbba0d13e0cf99dbd4879c1b21b9817d38d2d348043cb WatchSource:0}: Error finding container 6b0e4c22c5c56d4b06bbbba0d13e0cf99dbd4879c1b21b9817d38d2d348043cb: Status 404 returned error can't find the container with id 6b0e4c22c5c56d4b06bbbba0d13e0cf99dbd4879c1b21b9817d38d2d348043cb Jul 01 19:25:06.947431 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:06.947384 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bt4tw" event={"ID":"c3327b66-7666-4066-9d83-8af7c759a53f","Type":"ContainerStarted","Data":"6b0e4c22c5c56d4b06bbbba0d13e0cf99dbd4879c1b21b9817d38d2d348043cb"} Jul 01 19:25:08.957791 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:08.957756 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bt4tw" event={"ID":"c3327b66-7666-4066-9d83-8af7c759a53f","Type":"ContainerStarted","Data":"9753f716f1847ab5ba8798458e749708bfa61a38e0edbab566c4408a3b51c100"} Jul 01 19:25:08.958295 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:08.957820 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bt4tw" event={"ID":"c3327b66-7666-4066-9d83-8af7c759a53f","Type":"ContainerStarted","Data":"46d6704149b409252ca67612ddf9a5fb39660d40383c320188e31ad25a943ca4"} Jul 01 19:25:08.976618 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:08.976568 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bt4tw" podStartSLOduration=131.498561705 podStartE2EDuration="2m12.976554894s" totalImagesPullingTime="1.477993189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:25:08.97533161 +0000 UTC m=+133.121305354" watchObservedRunningTime="2026-07-01 19:25:08.976554894 +0000 UTC m=+133.122528635" Jul 01 19:25:12.204340 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:12.204306 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:12.204701 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:12.204391 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:12.208916 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:12.208888 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:12.979127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:12.979097 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:25:13.027123 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:13.027094 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:25:13.980290 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:13.980256 2563 generic.go:356] "Generic (PLEG): container finished" podID="13f53e22-1c5e-4d24-b391-669ee21b5a3f" containerID="b87f2bc59c9d0ee84915017543fe1ed187bab4bb8c5d0a58afa28482427d295b" exitCode=0 Jul 01 19:25:13.980860 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:13.980334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" event={"ID":"13f53e22-1c5e-4d24-b391-669ee21b5a3f","Type":"ContainerDied","Data":"b87f2bc59c9d0ee84915017543fe1ed187bab4bb8c5d0a58afa28482427d295b"} Jul 01 19:25:13.980860 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:13.980800 2563 scope.go:117] "RemoveContainer" containerID="b87f2bc59c9d0ee84915017543fe1ed187bab4bb8c5d0a58afa28482427d295b" Jul 01 19:25:14.636689 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:14.636651 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:25:14.636902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:14.636718 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:25:14.986491 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:14.986455 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-kd5j6" event={"ID":"13f53e22-1c5e-4d24-b391-669ee21b5a3f","Type":"ContainerStarted","Data":"a128fc6267610f101306d1e2983e4278c441dbcac1a188b94445f5dba09d1cb9"} Jul 01 19:25:17.930968 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:17.930897 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7974d894fb-fvc66" podUID="2a9808d8-c432-4ebd-b746-eaf169e576f2" containerName="console" containerID="cri-o://daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3" gracePeriod=15 Jul 01 19:25:18.183622 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.183566 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:25:18.249419 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249385 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.249605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249447 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.249605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249483 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl2r5\" (UniqueName: \"kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.249605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249523 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.249605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.249605 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249595 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert\") pod \"2a9808d8-c432-4ebd-b746-eaf169e576f2\" (UID: \"2a9808d8-c432-4ebd-b746-eaf169e576f2\") " Jul 01 19:25:18.250010 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.249861 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:18.250113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.250077 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config" (OuterVolumeSpecName: "console-config") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:18.250367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.250148 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:18.251843 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.251814 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5" (OuterVolumeSpecName: "kube-api-access-gl2r5") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "kube-api-access-gl2r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:18.251963 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.251845 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:18.251963 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.251868 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a9808d8-c432-4ebd-b746-eaf169e576f2" (UID: "2a9808d8-c432-4ebd-b746-eaf169e576f2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:18.350488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350451 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:18.350488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350484 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:18.350488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350493 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl2r5\" (UniqueName: \"kubernetes.io/projected/2a9808d8-c432-4ebd-b746-eaf169e576f2-kube-api-access-gl2r5\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:18.350704 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350502 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-oauth-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:18.350704 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350511 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-console-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:18.350704 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:18.350519 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a9808d8-c432-4ebd-b746-eaf169e576f2-oauth-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:19.005456 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.005422 2563 generic.go:356] "Generic (PLEG): container finished" podID="b4a45f67-7c52-48a3-b8c3-52833d2d0c7c" containerID="7d9995e48115e863ef9f197d8fabea3dca8856016b826da5ba7f409ecaac9cff" exitCode=0 Jul 01 19:25:19.005836 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.005495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" event={"ID":"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c","Type":"ContainerDied","Data":"7d9995e48115e863ef9f197d8fabea3dca8856016b826da5ba7f409ecaac9cff"} Jul 01 19:25:19.005940 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.005923 2563 scope.go:117] "RemoveContainer" containerID="7d9995e48115e863ef9f197d8fabea3dca8856016b826da5ba7f409ecaac9cff" Jul 01 19:25:19.006840 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.006814 2563 generic.go:356] "Generic (PLEG): container finished" podID="2a9808d8-c432-4ebd-b746-eaf169e576f2" containerID="daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3" exitCode=0 Jul 01 19:25:19.006952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.006865 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974d894fb-fvc66" Jul 01 19:25:19.006952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.006871 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974d894fb-fvc66" event={"ID":"2a9808d8-c432-4ebd-b746-eaf169e576f2","Type":"ContainerDied","Data":"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3"} Jul 01 19:25:19.006952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.006933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974d894fb-fvc66" event={"ID":"2a9808d8-c432-4ebd-b746-eaf169e576f2","Type":"ContainerDied","Data":"808f5655cf4893ae049d1a416eb40a6a51a23702f07caa5e53fe177eb5251e14"} Jul 01 19:25:19.006952 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.006951 2563 scope.go:117] "RemoveContainer" containerID="daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3" Jul 01 19:25:19.016216 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.016198 2563 scope.go:117] "RemoveContainer" containerID="daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3" Jul 01 19:25:19.016472 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:25:19.016455 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3\": container with ID starting with daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3 not found: ID does not exist" containerID="daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3" Jul 01 19:25:19.016519 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.016480 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3"} err="failed to get container status \"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3\": rpc error: code = NotFound desc = could not find container \"daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3\": container with ID starting with daae56918b70d2206284c15d37588ff7fa583acc06b2e4dfb3da26aaf175c4b3 not found: ID does not exist" Jul 01 19:25:19.054159 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.054131 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:25:19.057273 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:19.056779 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7974d894fb-fvc66"] Jul 01 19:25:20.013497 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:20.013460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-c4nzb" event={"ID":"b4a45f67-7c52-48a3-b8c3-52833d2d0c7c","Type":"ContainerStarted","Data":"a97e36de59256e06ffffce06d80ac8c99151d6a649bd2bd93f9b044c34117b8e"} Jul 01 19:25:20.289821 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:20.289747 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9808d8-c432-4ebd-b746-eaf169e576f2" path="/var/lib/kubelet/pods/2a9808d8-c432-4ebd-b746-eaf169e576f2/volumes" Jul 01 19:25:34.641279 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:34.641250 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:25:34.645262 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:34.645239 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-784b76946-pc5n2" Jul 01 19:25:35.089149 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:35.089112 2563 generic.go:356] "Generic (PLEG): container finished" podID="d06fa14d-c14f-486e-ac5e-9dbaeb496360" containerID="0b3c94d5e8fac8492ddb8f8c32bfb27bff7ddd30b15a6aaf02e9b60ea0072487" exitCode=0 Jul 01 19:25:35.089343 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:35.089196 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" event={"ID":"d06fa14d-c14f-486e-ac5e-9dbaeb496360","Type":"ContainerDied","Data":"0b3c94d5e8fac8492ddb8f8c32bfb27bff7ddd30b15a6aaf02e9b60ea0072487"} Jul 01 19:25:35.089672 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:35.089658 2563 scope.go:117] "RemoveContainer" containerID="0b3c94d5e8fac8492ddb8f8c32bfb27bff7ddd30b15a6aaf02e9b60ea0072487" Jul 01 19:25:36.096535 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:36.096501 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-pvz9x" event={"ID":"d06fa14d-c14f-486e-ac5e-9dbaeb496360","Type":"ContainerStarted","Data":"d8cfde3f6d0b5655174078bce2261e716570855fdda5ab1a0e4ac26749ad81f2"} Jul 01 19:25:38.048178 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.048136 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c5b76f988-wcdnd" podUID="5a70d781-e13c-4243-9686-bd50bda31a7f" containerName="console" containerID="cri-o://0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9" gracePeriod=15 Jul 01 19:25:38.333319 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.333292 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:25:38.438060 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438024 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438082 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tnbj\" (UniqueName: \"kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438124 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438151 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438230 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438181 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438246 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438280 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config\") pod \"5a70d781-e13c-4243-9686-bd50bda31a7f\" (UID: \"5a70d781-e13c-4243-9686-bd50bda31a7f\") " Jul 01 19:25:38.438604 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438563 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:38.438679 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438634 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:38.438679 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438643 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config" (OuterVolumeSpecName: "console-config") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:38.438679 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.438666 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:25:38.440596 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.440575 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:38.440981 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.440954 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:25:38.440981 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.440971 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj" (OuterVolumeSpecName: "kube-api-access-7tnbj") pod "5a70d781-e13c-4243-9686-bd50bda31a7f" (UID: "5a70d781-e13c-4243-9686-bd50bda31a7f"). InnerVolumeSpecName "kube-api-access-7tnbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:25:38.539680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539643 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-trusted-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539671 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tnbj\" (UniqueName: \"kubernetes.io/projected/5a70d781-e13c-4243-9686-bd50bda31a7f-kube-api-access-7tnbj\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539680 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539689 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539947 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539698 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-console-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539947 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539706 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a70d781-e13c-4243-9686-bd50bda31a7f-oauth-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:38.539947 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:38.539714 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a70d781-e13c-4243-9686-bd50bda31a7f-console-oauth-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:25:39.113693 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.113662 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a70d781-e13c-4243-9686-bd50bda31a7f" containerID="0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9" exitCode=0 Jul 01 19:25:39.114103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.113710 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c5b76f988-wcdnd" Jul 01 19:25:39.114103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.113743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5b76f988-wcdnd" event={"ID":"5a70d781-e13c-4243-9686-bd50bda31a7f","Type":"ContainerDied","Data":"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9"} Jul 01 19:25:39.114103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.113791 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c5b76f988-wcdnd" event={"ID":"5a70d781-e13c-4243-9686-bd50bda31a7f","Type":"ContainerDied","Data":"fae6f8ce1f396d0d63471484623bbe89acac69f184422c6cad17f0002f2f5b55"} Jul 01 19:25:39.114103 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.113811 2563 scope.go:117] "RemoveContainer" containerID="0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9" Jul 01 19:25:39.124836 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.124817 2563 scope.go:117] "RemoveContainer" containerID="0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9" Jul 01 19:25:39.125131 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:25:39.125114 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9\": container with ID starting with 0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9 not found: ID does not exist" containerID="0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9" Jul 01 19:25:39.125194 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.125142 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9"} err="failed to get container status \"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9\": rpc error: code = NotFound desc = could not find container \"0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9\": container with ID starting with 0a8467a4ad5f5cc4b0f532d618b4f3c9efd55ac0a835ada9fc8d7acda9f171e9 not found: ID does not exist" Jul 01 19:25:39.137507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.137486 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:25:39.143698 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:39.143677 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c5b76f988-wcdnd"] Jul 01 19:25:40.289022 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:25:40.288991 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a70d781-e13c-4243-9686-bd50bda31a7f" path="/var/lib/kubelet/pods/5a70d781-e13c-4243-9686-bd50bda31a7f/volumes" Jul 01 19:26:10.559677 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.559639 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.559972 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a70d781-e13c-4243-9686-bd50bda31a7f" containerName="console" Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.559983 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a70d781-e13c-4243-9686-bd50bda31a7f" containerName="console" Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.559996 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9808d8-c432-4ebd-b746-eaf169e576f2" containerName="console" Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.560002 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9808d8-c432-4ebd-b746-eaf169e576f2" containerName="console" Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.560071 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a70d781-e13c-4243-9686-bd50bda31a7f" containerName="console" Jul 01 19:26:10.560129 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.560080 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9808d8-c432-4ebd-b746-eaf169e576f2" containerName="console" Jul 01 19:26:10.563123 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.563104 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.586249 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.586221 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:26:10.611042 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611194 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611047 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611194 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611314 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611314 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpsh\" (UniqueName: \"kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611314 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611272 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.611435 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.611337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.711722 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.711687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.711920 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.711726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.711920 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.711776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.711920 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.711813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.711954 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpsh\" (UniqueName: \"kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712115 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712578 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712724 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.712778 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.713006 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.712978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.714459 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.714435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.714571 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.714439 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.726034 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.726010 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpsh\" (UniqueName: \"kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh\") pod \"console-69db8b5798-s2p7l\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:10.871982 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:10.871888 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:11.014670 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:11.014642 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:26:11.016740 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:26:11.016714 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1eb342_38d0_4fdc_897e_ea2dddf284c0.slice/crio-e6a4c8adeb829b1420de90f1bbba901de4f12370ef08d57195b1e24c1be34ce0 WatchSource:0}: Error finding container e6a4c8adeb829b1420de90f1bbba901de4f12370ef08d57195b1e24c1be34ce0: Status 404 returned error can't find the container with id e6a4c8adeb829b1420de90f1bbba901de4f12370ef08d57195b1e24c1be34ce0 Jul 01 19:26:11.249654 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:11.249619 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db8b5798-s2p7l" event={"ID":"cc1eb342-38d0-4fdc-897e-ea2dddf284c0","Type":"ContainerStarted","Data":"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235"} Jul 01 19:26:11.249841 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:11.249666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db8b5798-s2p7l" event={"ID":"cc1eb342-38d0-4fdc-897e-ea2dddf284c0","Type":"ContainerStarted","Data":"e6a4c8adeb829b1420de90f1bbba901de4f12370ef08d57195b1e24c1be34ce0"} Jul 01 19:26:11.273930 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:11.273869 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69db8b5798-s2p7l" podStartSLOduration=1.273854941 podStartE2EDuration="1.273854941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:11.27101068 +0000 UTC m=+195.416984432" watchObservedRunningTime="2026-07-01 19:26:11.273854941 +0000 UTC m=+195.419828685" Jul 01 19:26:12.811726 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.811689 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:12.814943 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.814924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.817745 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.817721 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 19:26:12.817903 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.817870 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 19:26:12.817978 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.817901 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 19:26:12.818041 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.817975 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 19:26:12.818041 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.818000 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 19:26:12.818265 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.818239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xhhwk\"" Jul 01 19:26:12.818364 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.818286 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 19:26:12.818364 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.818289 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 19:26:12.818364 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.818300 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 19:26:12.823059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.823041 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 19:26:12.839072 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.839044 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:12.930696 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930696 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-config-volume\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930717 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-config-out\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-web-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.930934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p48mn\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-kube-api-access-p48mn\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.930976 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.931014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.931049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.931065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:12.931113 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:12.931091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p48mn\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-kube-api-access-p48mn\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032507 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032546 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032646 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032683 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.032715 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032711 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-config-volume\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033030 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033030 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-config-out\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033030 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-web-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033030 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033030 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.032939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.033574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.033835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.033659 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.034174 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.034146 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.036155 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.036271 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036176 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.036271 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-config-volume\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.036597 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.036719 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036667 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.037013 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.036980 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.037250 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.037228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.037342 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.037328 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02c47b8b-0d42-4403-a897-02477a524135-web-config\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.037705 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.037690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02c47b8b-0d42-4403-a897-02477a524135-config-out\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.044074 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.044057 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p48mn\" (UniqueName: \"kubernetes.io/projected/02c47b8b-0d42-4403-a897-02477a524135-kube-api-access-p48mn\") pod \"alertmanager-main-0\" (UID: \"02c47b8b-0d42-4403-a897-02477a524135\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.127367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.127279 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 19:26:13.288388 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:13.288361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 19:26:13.291732 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:26:13.291703 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c47b8b_0d42_4403_a897_02477a524135.slice/crio-6dd2c545db611d5e9dfcd680df56e35e3869f4fd0024d5862b81d3ea526a625c WatchSource:0}: Error finding container 6dd2c545db611d5e9dfcd680df56e35e3869f4fd0024d5862b81d3ea526a625c: Status 404 returned error can't find the container with id 6dd2c545db611d5e9dfcd680df56e35e3869f4fd0024d5862b81d3ea526a625c Jul 01 19:26:14.264612 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:14.264581 2563 generic.go:356] "Generic (PLEG): container finished" podID="02c47b8b-0d42-4403-a897-02477a524135" containerID="19dd2a4ce5803f288aaac7e74bc4eafdcdef61a8dc14cf2ac0ae26872f7b02cc" exitCode=0 Jul 01 19:26:14.265095 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:14.264626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerDied","Data":"19dd2a4ce5803f288aaac7e74bc4eafdcdef61a8dc14cf2ac0ae26872f7b02cc"} Jul 01 19:26:14.265095 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:14.264677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"6dd2c545db611d5e9dfcd680df56e35e3869f4fd0024d5862b81d3ea526a625c"} Jul 01 19:26:16.277376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:16.277338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"7b7634c4de05af8ca0919a6c0816bad2b18952e470a800bafc60faa2e30643c3"} Jul 01 19:26:16.278002 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:16.277468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"90ec220d1c3706b8b64426aa7e55b25acd40a746ff8e15a53d9c1325e14875cb"} Jul 01 19:26:16.278002 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:16.277508 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"20c2e1693731c7f9277280a38379a68e87ae15e5e0c9d9690315b0ebbe8914aa"} Jul 01 19:26:17.285015 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:17.284971 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"250b17aa20feefa7d870d7ae0ccbf9fda071f9b36df002b088fadb1e85c8ec62"} Jul 01 19:26:17.285422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:17.285042 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"60912a2cc9159ac943f8579fb5c1d321f715b15954b19107bd4652851672d43d"} Jul 01 19:26:17.285422 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:17.285070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02c47b8b-0d42-4403-a897-02477a524135","Type":"ContainerStarted","Data":"0b62f26a578dbb575de62071fdfa68f209fb6a752e4bc3398b0946472a965965"} Jul 01 19:26:17.316286 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:17.316233 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.499759474 podStartE2EDuration="5.316216521s" totalImagesPullingTime="1.79975589s" totalInitContainerRuntime="16.701157ms" isStatefulPod=false podCreationTimestamp="2026-07-01 19:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:26:17.314368345 +0000 UTC m=+201.460342085" watchObservedRunningTime="2026-07-01 19:26:17.316216521 +0000 UTC m=+201.462190262" Jul 01 19:26:20.872932 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:20.872893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:20.873362 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:20.872966 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:20.877363 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:20.877342 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:21.310298 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:21.310271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:26:21.373520 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:21.373485 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:26:46.394258 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.394205 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bdc845b5f-bdfbg" podUID="45719c7e-9b0d-414d-9f8c-651247911d69" containerName="console" containerID="cri-o://1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d" gracePeriod=15 Jul 01 19:26:46.647490 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.647435 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:26:46.735042 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.734999 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735063 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735087 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zm2v\" (UniqueName: \"kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735179 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735351 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735224 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735351 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735328 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735452 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735354 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert\") pod \"45719c7e-9b0d-414d-9f8c-651247911d69\" (UID: \"45719c7e-9b0d-414d-9f8c-651247911d69\") " Jul 01 19:26:46.735625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735529 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca" (OuterVolumeSpecName: "service-ca") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:46.735625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735506 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:46.735625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735598 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config" (OuterVolumeSpecName: "console-config") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:46.735835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735670 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.735835 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.735689 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:26:46.737410 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.737381 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v" (OuterVolumeSpecName: "kube-api-access-8zm2v") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "kube-api-access-8zm2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:26:46.737410 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.737388 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:46.737582 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.737560 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45719c7e-9b0d-414d-9f8c-651247911d69" (UID: "45719c7e-9b0d-414d-9f8c-651247911d69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:26:46.836761 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836733 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-oauth-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.836761 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836756 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-oauth-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.836761 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836766 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45719c7e-9b0d-414d-9f8c-651247911d69-console-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.836993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836775 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-trusted-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.836993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836783 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zm2v\" (UniqueName: \"kubernetes.io/projected/45719c7e-9b0d-414d-9f8c-651247911d69-kube-api-access-8zm2v\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:46.836993 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:46.836792 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45719c7e-9b0d-414d-9f8c-651247911d69-console-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:26:47.422327 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.422292 2563 generic.go:356] "Generic (PLEG): container finished" podID="45719c7e-9b0d-414d-9f8c-651247911d69" containerID="1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d" exitCode=0 Jul 01 19:26:47.422781 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.422341 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdc845b5f-bdfbg" Jul 01 19:26:47.422781 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.422373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc845b5f-bdfbg" event={"ID":"45719c7e-9b0d-414d-9f8c-651247911d69","Type":"ContainerDied","Data":"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d"} Jul 01 19:26:47.422781 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.422422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdc845b5f-bdfbg" event={"ID":"45719c7e-9b0d-414d-9f8c-651247911d69","Type":"ContainerDied","Data":"6f6ca21b0c203bceb032928a9b43ed39068db2f6dde41d8eae83d7d7579a36c5"} Jul 01 19:26:47.422781 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.422442 2563 scope.go:117] "RemoveContainer" containerID="1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d" Jul 01 19:26:47.431576 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.431561 2563 scope.go:117] "RemoveContainer" containerID="1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d" Jul 01 19:26:47.431841 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:26:47.431824 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d\": container with ID starting with 1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d not found: ID does not exist" containerID="1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d" Jul 01 19:26:47.431912 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.431849 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d"} err="failed to get container status \"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d\": rpc error: code = NotFound desc = could not find container \"1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d\": container with ID starting with 1cbc2ca63a3687c60f81fa0552f482fa577b8ec77a1195a0a7e4bfa0ebb1c03d not found: ID does not exist" Jul 01 19:26:47.444563 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.444540 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:26:47.451137 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:47.451107 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdc845b5f-bdfbg"] Jul 01 19:26:48.289019 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:48.288987 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45719c7e-9b0d-414d-9f8c-651247911d69" path="/var/lib/kubelet/pods/45719c7e-9b0d-414d-9f8c-651247911d69/volumes" Jul 01 19:26:55.378009 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.377976 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp"] Jul 01 19:26:55.378368 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.378293 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45719c7e-9b0d-414d-9f8c-651247911d69" containerName="console" Jul 01 19:26:55.378368 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.378304 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="45719c7e-9b0d-414d-9f8c-651247911d69" containerName="console" Jul 01 19:26:55.378437 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.378376 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="45719c7e-9b0d-414d-9f8c-651247911d69" containerName="console" Jul 01 19:26:55.382089 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.382074 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.384598 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.384578 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2lrpv\"" Jul 01 19:26:55.385490 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.385473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 01 19:26:55.385553 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.385473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 01 19:26:55.408095 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.408070 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp"] Jul 01 19:26:55.408421 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.408405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.408470 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.408438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8hg\" (UniqueName: \"kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.408470 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.408459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.509367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.509327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.509520 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.509389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8hg\" (UniqueName: \"kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.509520 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.509416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.509756 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.509731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.509892 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.509822 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.522916 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.522865 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8hg\" (UniqueName: \"kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.690933 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.690855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:26:55.842891 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:55.842853 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp"] Jul 01 19:26:55.845309 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:26:55.845284 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9572dc_6afc_48a4_acf6_3200075709ee.slice/crio-1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17 WatchSource:0}: Error finding container 1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17: Status 404 returned error can't find the container with id 1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17 Jul 01 19:26:56.462972 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:26:56.462936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" event={"ID":"8a9572dc-6afc-48a4-acf6-3200075709ee","Type":"ContainerStarted","Data":"1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17"} Jul 01 19:27:02.496423 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:02.496390 2563 generic.go:356] "Generic (PLEG): container finished" podID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerID="0a8839605f629994ce821e6d1f0242ae4ccc15f04d1ea6b0d26ad01c18d66fa6" exitCode=0 Jul 01 19:27:02.496957 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:02.496437 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" event={"ID":"8a9572dc-6afc-48a4-acf6-3200075709ee","Type":"ContainerDied","Data":"0a8839605f629994ce821e6d1f0242ae4ccc15f04d1ea6b0d26ad01c18d66fa6"} Jul 01 19:27:05.512017 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:05.511984 2563 generic.go:356] "Generic (PLEG): container finished" podID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerID="ae6dd5061a2f4c03db47ae2662890e361b294ba738c61cdd70eb1c03324e84fc" exitCode=0 Jul 01 19:27:05.512493 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:05.512070 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" event={"ID":"8a9572dc-6afc-48a4-acf6-3200075709ee","Type":"ContainerDied","Data":"ae6dd5061a2f4c03db47ae2662890e361b294ba738c61cdd70eb1c03324e84fc"} Jul 01 19:27:12.549041 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:12.549004 2563 generic.go:356] "Generic (PLEG): container finished" podID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerID="f384896904f0648728751487a307024aa6dffa05cd2949f71869240a315a9484" exitCode=0 Jul 01 19:27:12.549425 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:12.549103 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" event={"ID":"8a9572dc-6afc-48a4-acf6-3200075709ee","Type":"ContainerDied","Data":"f384896904f0648728751487a307024aa6dffa05cd2949f71869240a315a9484"} Jul 01 19:27:13.684306 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.684282 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:27:13.774483 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.774442 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle\") pod \"8a9572dc-6afc-48a4-acf6-3200075709ee\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " Jul 01 19:27:13.774483 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.774482 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util\") pod \"8a9572dc-6afc-48a4-acf6-3200075709ee\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " Jul 01 19:27:13.774696 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.774516 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m8hg\" (UniqueName: \"kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg\") pod \"8a9572dc-6afc-48a4-acf6-3200075709ee\" (UID: \"8a9572dc-6afc-48a4-acf6-3200075709ee\") " Jul 01 19:27:13.775246 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.775222 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle" (OuterVolumeSpecName: "bundle") pod "8a9572dc-6afc-48a4-acf6-3200075709ee" (UID: "8a9572dc-6afc-48a4-acf6-3200075709ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:27:13.776926 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.776903 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg" (OuterVolumeSpecName: "kube-api-access-5m8hg") pod "8a9572dc-6afc-48a4-acf6-3200075709ee" (UID: "8a9572dc-6afc-48a4-acf6-3200075709ee"). InnerVolumeSpecName "kube-api-access-5m8hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:27:13.778967 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.778945 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util" (OuterVolumeSpecName: "util") pod "8a9572dc-6afc-48a4-acf6-3200075709ee" (UID: "8a9572dc-6afc-48a4-acf6-3200075709ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:27:13.875346 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.875263 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m8hg\" (UniqueName: \"kubernetes.io/projected/8a9572dc-6afc-48a4-acf6-3200075709ee-kube-api-access-5m8hg\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:27:13.875346 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.875293 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:27:13.875346 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:13.875302 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a9572dc-6afc-48a4-acf6-3200075709ee-util\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:27:14.559735 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:14.559649 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" Jul 01 19:27:14.559735 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:14.559657 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589ggcmp" event={"ID":"8a9572dc-6afc-48a4-acf6-3200075709ee","Type":"ContainerDied","Data":"1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17"} Jul 01 19:27:14.559735 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:14.559703 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1140ac674c0c9bf74499bf553d35955d57c106094c2a43c8d16ac20944985b17" Jul 01 19:27:18.359902 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.359809 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj"] Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360168 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="extract" Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360179 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="extract" Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360189 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="pull" Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360194 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="pull" Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360202 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="util" Jul 01 19:27:18.360259 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360207 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="util" Jul 01 19:27:18.360436 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.360272 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9572dc-6afc-48a4-acf6-3200075709ee" containerName="extract" Jul 01 19:27:18.416529 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.416505 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj"] Jul 01 19:27:18.416677 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.416586 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.421266 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.421247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 19:27:18.421660 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.421642 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-6m52w\"" Jul 01 19:27:18.421740 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.421667 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 19:27:18.421740 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.421641 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 19:27:18.515772 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.515735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wfb\" (UniqueName: \"kubernetes.io/projected/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-kube-api-access-w6wfb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.515958 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.515786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.617210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.617133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wfb\" (UniqueName: \"kubernetes.io/projected/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-kube-api-access-w6wfb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.617210 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.617189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.619621 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.619602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.630816 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.630791 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wfb\" (UniqueName: \"kubernetes.io/projected/b4a1fc65-a1ed-4011-9cc4-a034842f1f9a-kube-api-access-w6wfb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj\" (UID: \"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.726494 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.726469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:18.893801 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:18.893778 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj"] Jul 01 19:27:18.895901 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:27:18.895860 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a1fc65_a1ed_4011_9cc4_a034842f1f9a.slice/crio-a5946f9850c40f90cc3466c551f5294418fd327f3e3f49e76316d47cb90e6c98 WatchSource:0}: Error finding container a5946f9850c40f90cc3466c551f5294418fd327f3e3f49e76316d47cb90e6c98: Status 404 returned error can't find the container with id a5946f9850c40f90cc3466c551f5294418fd327f3e3f49e76316d47cb90e6c98 Jul 01 19:27:19.581744 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:19.581712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" event={"ID":"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a","Type":"ContainerStarted","Data":"a5946f9850c40f90cc3466c551f5294418fd327f3e3f49e76316d47cb90e6c98"} Jul 01 19:27:22.599560 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:22.599510 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" event={"ID":"b4a1fc65-a1ed-4011-9cc4-a034842f1f9a","Type":"ContainerStarted","Data":"ba4176fe04b16b27a12a20e184556f880f525a1fb4bb6a4b324ece46c5442aaa"} Jul 01 19:27:22.599925 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:22.599637 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:22.619244 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:22.619195 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" podStartSLOduration=1.040457477 podStartE2EDuration="4.61917765s" totalImagesPullingTime="3.578720173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:22.618193536 +0000 UTC m=+266.764167290" watchObservedRunningTime="2026-07-01 19:27:22.61917765 +0000 UTC m=+266.765151393" Jul 01 19:27:23.414377 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.414345 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-28sx6"] Jul 01 19:27:23.439246 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.439207 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-28sx6"] Jul 01 19:27:23.439393 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.439298 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.441768 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.441746 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 19:27:23.442131 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.442113 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 01 19:27:23.442254 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.442237 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-xqkzt\"" Jul 01 19:27:23.563084 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.563052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.563247 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.563103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzm75\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-kube-api-access-wzm75\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.563247 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.563137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d22654f6-cf81-4af4-bf14-4e47484e05a2-cabundle0\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.634864 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.634827 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-b7kng"] Jul 01 19:27:23.657202 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.657169 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-b7kng"] Jul 01 19:27:23.657351 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.657252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.660064 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.660044 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 01 19:27:23.664267 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.664240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.664409 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.664311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzm75\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-kube-api-access-wzm75\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.664409 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.664366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d22654f6-cf81-4af4-bf14-4e47484e05a2-cabundle0\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.664409 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.664381 2563 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 01 19:27:23.664409 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.664398 2563 secret.go:281] references non-existent secret key: ca.crt Jul 01 19:27:23.664409 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.664409 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 01 19:27:23.664651 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.664423 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-28sx6: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 01 19:27:23.664651 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.664476 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates podName:d22654f6-cf81-4af4-bf14-4e47484e05a2 nodeName:}" failed. No retries permitted until 2026-07-01 19:27:24.164456027 +0000 UTC m=+268.310429749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates") pod "keda-operator-68bff59c-28sx6" (UID: "d22654f6-cf81-4af4-bf14-4e47484e05a2") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 01 19:27:23.665120 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.665093 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/d22654f6-cf81-4af4-bf14-4e47484e05a2-cabundle0\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.673646 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.673622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzm75\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-kube-api-access-wzm75\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:23.764858 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.764823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.765050 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.764895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mzs\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-kube-api-access-42mzs\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.765050 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.764947 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/aacd5712-5055-4d56-8dd0-a26eac5de963-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.865813 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.865771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.866023 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.865821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mzs\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-kube-api-access-42mzs\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.866023 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.865937 2563 secret.go:281] references non-existent secret key: tls.crt Jul 01 19:27:23.866023 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.865958 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 01 19:27:23.866023 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.865973 2563 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Jul 01 19:27:23.866023 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.865990 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-b7kng: [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 01 19:27:23.866282 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:23.866047 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates podName:aacd5712-5055-4d56-8dd0-a26eac5de963 nodeName:}" failed. No retries permitted until 2026-07-01 19:27:24.36603236 +0000 UTC m=+268.512006082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates") pod "keda-metrics-apiserver-559f75f947-b7kng" (UID: "aacd5712-5055-4d56-8dd0-a26eac5de963") : [references non-existent secret key: tls.crt, secret "keda-metrics-apiserver-certs" not found] Jul 01 19:27:23.866282 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.865969 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/aacd5712-5055-4d56-8dd0-a26eac5de963-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.866357 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.866289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/aacd5712-5055-4d56-8dd0-a26eac5de963-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:23.877171 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:23.877145 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mzs\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-kube-api-access-42mzs\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:24.169397 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.169360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:24.169571 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.169505 2563 secret.go:281] references non-existent secret key: ca.crt Jul 01 19:27:24.169571 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.169521 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 01 19:27:24.169571 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.169530 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-28sx6: references non-existent secret key: ca.crt Jul 01 19:27:24.169701 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.169580 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates podName:d22654f6-cf81-4af4-bf14-4e47484e05a2 nodeName:}" failed. No retries permitted until 2026-07-01 19:27:25.169566143 +0000 UTC m=+269.315539866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates") pod "keda-operator-68bff59c-28sx6" (UID: "d22654f6-cf81-4af4-bf14-4e47484e05a2") : references non-existent secret key: ca.crt Jul 01 19:27:24.371478 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.371437 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:24.371678 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.371603 2563 secret.go:281] references non-existent secret key: tls.crt Jul 01 19:27:24.371678 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.371622 2563 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 01 19:27:24.371678 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.371639 2563 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-b7kng: references non-existent secret key: tls.crt Jul 01 19:27:24.371834 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:27:24.371693 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates podName:aacd5712-5055-4d56-8dd0-a26eac5de963 nodeName:}" failed. No retries permitted until 2026-07-01 19:27:25.37167912 +0000 UTC m=+269.517652839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates") pod "keda-metrics-apiserver-559f75f947-b7kng" (UID: "aacd5712-5055-4d56-8dd0-a26eac5de963") : references non-existent secret key: tls.crt Jul 01 19:27:24.592514 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.592471 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-rrd6c"] Jul 01 19:27:24.616583 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.616558 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-rrd6c"] Jul 01 19:27:24.616744 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.616646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.619028 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.619004 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 19:27:24.775188 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.775151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-certificates\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.775603 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.775213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blgxb\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-kube-api-access-blgxb\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.876365 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.876283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-certificates\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.876365 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.876330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blgxb\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-kube-api-access-blgxb\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.879134 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.879105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-certificates\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.890752 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.890720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blgxb\" (UniqueName: \"kubernetes.io/projected/5c167660-8631-4c0a-8839-9e2c0c7457d8-kube-api-access-blgxb\") pod \"keda-admission-5fbd5c4644-rrd6c\" (UID: \"5c167660-8631-4c0a-8839-9e2c0c7457d8\") " pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:24.927933 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:24.927672 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:25.122069 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.119640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-rrd6c"] Jul 01 19:27:25.181303 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.181216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:25.183695 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.183674 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d22654f6-cf81-4af4-bf14-4e47484e05a2-certificates\") pod \"keda-operator-68bff59c-28sx6\" (UID: \"d22654f6-cf81-4af4-bf14-4e47484e05a2\") " pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:25.249973 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.249928 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:25.382442 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.382407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:25.386035 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.386006 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/aacd5712-5055-4d56-8dd0-a26eac5de963-certificates\") pod \"keda-metrics-apiserver-559f75f947-b7kng\" (UID: \"aacd5712-5055-4d56-8dd0-a26eac5de963\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:25.431762 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.431695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-28sx6"] Jul 01 19:27:25.435384 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:27:25.435357 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22654f6_cf81_4af4_bf14_4e47484e05a2.slice/crio-5ca3011b1fd8f5f1a264c057081190fb49346be27ed0de809b3ec14580f1a0b8 WatchSource:0}: Error finding container 5ca3011b1fd8f5f1a264c057081190fb49346be27ed0de809b3ec14580f1a0b8: Status 404 returned error can't find the container with id 5ca3011b1fd8f5f1a264c057081190fb49346be27ed0de809b3ec14580f1a0b8 Jul 01 19:27:25.470648 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.470620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:25.615610 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.615580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-28sx6" event={"ID":"d22654f6-cf81-4af4-bf14-4e47484e05a2","Type":"ContainerStarted","Data":"5ca3011b1fd8f5f1a264c057081190fb49346be27ed0de809b3ec14580f1a0b8"} Jul 01 19:27:25.616740 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.616714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" event={"ID":"5c167660-8631-4c0a-8839-9e2c0c7457d8","Type":"ContainerStarted","Data":"69eaa2b1cba77cd298be435bc2a6bcc7ab0a21f43ce676b792efce8006835978"} Jul 01 19:27:25.648472 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:25.648448 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-b7kng"] Jul 01 19:27:25.649406 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:27:25.649378 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacd5712_5055_4d56_8dd0_a26eac5de963.slice/crio-428912fc1c31bcc6e61e9511cbd765b8eb83471d75ab13a6cefc9b415a20370b WatchSource:0}: Error finding container 428912fc1c31bcc6e61e9511cbd765b8eb83471d75ab13a6cefc9b415a20370b: Status 404 returned error can't find the container with id 428912fc1c31bcc6e61e9511cbd765b8eb83471d75ab13a6cefc9b415a20370b Jul 01 19:27:26.623983 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:26.623946 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" event={"ID":"aacd5712-5055-4d56-8dd0-a26eac5de963","Type":"ContainerStarted","Data":"428912fc1c31bcc6e61e9511cbd765b8eb83471d75ab13a6cefc9b415a20370b"} Jul 01 19:27:28.637428 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:28.637346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" event={"ID":"aacd5712-5055-4d56-8dd0-a26eac5de963","Type":"ContainerStarted","Data":"69d2f593105e3d2b197dab2ec68aca5916d09fc738f60a1d4a413fb8e36d4e0c"} Jul 01 19:27:28.637909 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:28.637494 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:28.669522 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:28.669313 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" podStartSLOduration=2.980065738 podStartE2EDuration="5.669296791s" totalImagesPullingTime="2.689231053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:28.667412165 +0000 UTC m=+272.813385907" watchObservedRunningTime="2026-07-01 19:27:28.669296791 +0000 UTC m=+272.815270532" Jul 01 19:27:29.645692 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:29.645601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" event={"ID":"5c167660-8631-4c0a-8839-9e2c0c7457d8","Type":"ContainerStarted","Data":"a3b836f9b8e984fff16179e38e53e24d0d278605d6cb6ef5766d7657d081f3b1"} Jul 01 19:27:29.671267 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:29.671219 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" podStartSLOduration=1.432055319 podStartE2EDuration="5.671203782s" totalImagesPullingTime="4.239148463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:29.671010266 +0000 UTC m=+273.816984008" watchObservedRunningTime="2026-07-01 19:27:29.671203782 +0000 UTC m=+273.817177524" Jul 01 19:27:30.650390 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:30.650358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:33.666738 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:33.666702 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-28sx6" event={"ID":"d22654f6-cf81-4af4-bf14-4e47484e05a2","Type":"ContainerStarted","Data":"c08aabf139028128380a66d978718319a16582dd494c0b2f26faa8bf0262ca63"} Jul 01 19:27:33.667315 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:33.666807 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:39.650372 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:39.650344 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-b7kng" Jul 01 19:27:39.669133 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:39.669089 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-28sx6" podStartSLOduration=9.265207025 podStartE2EDuration="16.669074559s" totalImagesPullingTime="7.403867534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:27:33.698041259 +0000 UTC m=+277.844015001" watchObservedRunningTime="2026-07-01 19:27:39.669074559 +0000 UTC m=+283.815048279" Jul 01 19:27:43.606723 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:43.606696 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pp5dj" Jul 01 19:27:51.656851 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:51.656817 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-rrd6c" Jul 01 19:27:54.673934 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:54.673900 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-28sx6" Jul 01 19:27:56.236228 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:56.236200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:27:56.237243 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:56.237223 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:27:56.243891 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:27:56.243851 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 19:28:30.945025 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.944994 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-cjvtg"] Jul 01 19:28:30.947618 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.947603 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:30.950967 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.950945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 19:28:30.951311 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.951296 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 01 19:28:30.951648 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.951630 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-m5rwq\"" Jul 01 19:28:30.951916 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.951868 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 19:28:30.972987 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.972957 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-cjvtg"] Jul 01 19:28:30.976583 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.976557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:30.976680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.976602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hxf\" (UniqueName: \"kubernetes.io/projected/fd296ecc-7a63-4fa6-9568-d699558a0938-kube-api-access-z5hxf\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:30.989578 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.989555 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-4rjhl"] Jul 01 19:28:30.992201 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.992183 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:30.996294 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.996274 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 19:28:30.996434 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:30.996419 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-ppnjn\"" Jul 01 19:28:31.005563 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.005546 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-4rjhl"] Jul 01 19:28:31.077164 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.077132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:31.077164 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.077166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hxf\" (UniqueName: \"kubernetes.io/projected/fd296ecc-7a63-4fa6-9568-d699558a0938-kube-api-access-z5hxf\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:31.077379 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.077191 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1565f5d-c901-4d00-91bb-c3527cbc50ce-data\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.077379 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.077240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fchsp\" (UniqueName: \"kubernetes.io/projected/f1565f5d-c901-4d00-91bb-c3527cbc50ce-kube-api-access-fchsp\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.077379 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:28:31.077277 2563 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 19:28:31.077379 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:28:31.077341 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert podName:fd296ecc-7a63-4fa6-9568-d699558a0938 nodeName:}" failed. No retries permitted until 2026-07-01 19:28:31.577324089 +0000 UTC m=+335.723297808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert") pod "llmisvc-controller-manager-67d95fdc48-cjvtg" (UID: "fd296ecc-7a63-4fa6-9568-d699558a0938") : secret "llmisvc-webhook-server-cert" not found Jul 01 19:28:31.091586 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.091562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hxf\" (UniqueName: \"kubernetes.io/projected/fd296ecc-7a63-4fa6-9568-d699558a0938-kube-api-access-z5hxf\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:31.178340 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.178308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fchsp\" (UniqueName: \"kubernetes.io/projected/f1565f5d-c901-4d00-91bb-c3527cbc50ce-kube-api-access-fchsp\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.178495 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.178411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1565f5d-c901-4d00-91bb-c3527cbc50ce-data\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.178791 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.178768 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1565f5d-c901-4d00-91bb-c3527cbc50ce-data\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.186844 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.186821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fchsp\" (UniqueName: \"kubernetes.io/projected/f1565f5d-c901-4d00-91bb-c3527cbc50ce-kube-api-access-fchsp\") pod \"seaweedfs-64568bcd49-4rjhl\" (UID: \"f1565f5d-c901-4d00-91bb-c3527cbc50ce\") " pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.303207 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.303174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:31.435229 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.435185 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-4rjhl"] Jul 01 19:28:31.439444 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:28:31.439421 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1565f5d_c901_4d00_91bb_c3527cbc50ce.slice/crio-928e7d7a844effe6d830da779f3c5b84b01acc09ce6d784cdfc3fb66905d7e71 WatchSource:0}: Error finding container 928e7d7a844effe6d830da779f3c5b84b01acc09ce6d784cdfc3fb66905d7e71: Status 404 returned error can't find the container with id 928e7d7a844effe6d830da779f3c5b84b01acc09ce6d784cdfc3fb66905d7e71 Jul 01 19:28:31.440733 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.440717 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 19:28:31.582578 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.582490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:31.582718 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:28:31.582631 2563 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 01 19:28:31.582718 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:28:31.582692 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert podName:fd296ecc-7a63-4fa6-9568-d699558a0938 nodeName:}" failed. No retries permitted until 2026-07-01 19:28:32.582676962 +0000 UTC m=+336.728650681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert") pod "llmisvc-controller-manager-67d95fdc48-cjvtg" (UID: "fd296ecc-7a63-4fa6-9568-d699558a0938") : secret "llmisvc-webhook-server-cert" not found Jul 01 19:28:31.937376 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:31.937284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-4rjhl" event={"ID":"f1565f5d-c901-4d00-91bb-c3527cbc50ce","Type":"ContainerStarted","Data":"928e7d7a844effe6d830da779f3c5b84b01acc09ce6d784cdfc3fb66905d7e71"} Jul 01 19:28:32.595375 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:32.595330 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:32.598281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:32.598248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd296ecc-7a63-4fa6-9568-d699558a0938-cert\") pod \"llmisvc-controller-manager-67d95fdc48-cjvtg\" (UID: \"fd296ecc-7a63-4fa6-9568-d699558a0938\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:32.760088 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:32.760039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:32.907242 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:32.907219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-cjvtg"] Jul 01 19:28:32.909290 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:28:32.909262 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd296ecc_7a63_4fa6_9568_d699558a0938.slice/crio-a540226427852d978aa700787d7b0237c51031a4acd9ff3201a0b5eaaddc84d0 WatchSource:0}: Error finding container a540226427852d978aa700787d7b0237c51031a4acd9ff3201a0b5eaaddc84d0: Status 404 returned error can't find the container with id a540226427852d978aa700787d7b0237c51031a4acd9ff3201a0b5eaaddc84d0 Jul 01 19:28:32.944629 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:32.944584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" event={"ID":"fd296ecc-7a63-4fa6-9568-d699558a0938","Type":"ContainerStarted","Data":"a540226427852d978aa700787d7b0237c51031a4acd9ff3201a0b5eaaddc84d0"} Jul 01 19:28:35.962753 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:35.962713 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-4rjhl" event={"ID":"f1565f5d-c901-4d00-91bb-c3527cbc50ce","Type":"ContainerStarted","Data":"8d2de0f843456ab40943e834d515a8b8de07bef17037eb5e7c5821dfa0909f07"} Jul 01 19:28:35.963199 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:35.962915 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:28:35.964223 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:35.964198 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" event={"ID":"fd296ecc-7a63-4fa6-9568-d699558a0938","Type":"ContainerStarted","Data":"7933c76ac39ed8d24e3a081cf5d83010e10dbebe77b6e70ab7ca79d229275dd0"} Jul 01 19:28:35.964338 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:35.964249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:28:35.987398 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:35.987358 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-4rjhl" podStartSLOduration=1.887097161 podStartE2EDuration="5.987346534s" totalImagesPullingTime="4.100249373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:35.985153507 +0000 UTC m=+340.131127248" watchObservedRunningTime="2026-07-01 19:28:35.987346534 +0000 UTC m=+340.133320311" Jul 01 19:28:36.012490 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:36.012447 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" podStartSLOduration=3.349405272 podStartE2EDuration="6.012435549s" totalImagesPullingTime="2.663030277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:28:36.010782221 +0000 UTC m=+340.156755961" watchObservedRunningTime="2026-07-01 19:28:36.012435549 +0000 UTC m=+340.158409291" Jul 01 19:28:41.971776 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:28:41.971745 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-4rjhl" Jul 01 19:29:06.971591 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:06.971515 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-cjvtg" Jul 01 19:29:41.858447 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.858416 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-dbjnp"] Jul 01 19:29:41.861047 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.861030 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:41.863426 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.863401 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-5fsgd\"" Jul 01 19:29:41.864862 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.864847 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 01 19:29:41.881320 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.881289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-dbjnp"] Jul 01 19:29:41.915466 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.915436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:41.915586 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:41.915504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxqw5\" (UniqueName: \"kubernetes.io/projected/bfa993ec-0c57-45f8-827c-6b1b84b4b517-kube-api-access-jxqw5\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.016973 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.016939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.017180 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.017008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxqw5\" (UniqueName: \"kubernetes.io/projected/bfa993ec-0c57-45f8-827c-6b1b84b4b517-kube-api-access-jxqw5\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.017180 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:29:42.017113 2563 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 01 19:29:42.017323 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:29:42.017190 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs podName:bfa993ec-0c57-45f8-827c-6b1b84b4b517 nodeName:}" failed. No retries permitted until 2026-07-01 19:29:42.517167014 +0000 UTC m=+406.663140733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs") pod "model-serving-api-fd65d7d6-dbjnp" (UID: "bfa993ec-0c57-45f8-827c-6b1b84b4b517") : secret "model-serving-api-tls" not found Jul 01 19:29:42.030682 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.030652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxqw5\" (UniqueName: \"kubernetes.io/projected/bfa993ec-0c57-45f8-827c-6b1b84b4b517-kube-api-access-jxqw5\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.519692 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.519655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.522127 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.522107 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfa993ec-0c57-45f8-827c-6b1b84b4b517-tls-certs\") pod \"model-serving-api-fd65d7d6-dbjnp\" (UID: \"bfa993ec-0c57-45f8-827c-6b1b84b4b517\") " pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.772147 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.772068 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:42.915045 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:42.915018 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-dbjnp"] Jul 01 19:29:42.916249 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:29:42.916223 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa993ec_0c57_45f8_827c_6b1b84b4b517.slice/crio-c03b0f4d8766dd7087da572114e35908d74a8d9f25f2dfa9b120427a0a4b1c41 WatchSource:0}: Error finding container c03b0f4d8766dd7087da572114e35908d74a8d9f25f2dfa9b120427a0a4b1c41: Status 404 returned error can't find the container with id c03b0f4d8766dd7087da572114e35908d74a8d9f25f2dfa9b120427a0a4b1c41 Jul 01 19:29:43.281214 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:43.281184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-dbjnp" event={"ID":"bfa993ec-0c57-45f8-827c-6b1b84b4b517","Type":"ContainerStarted","Data":"c03b0f4d8766dd7087da572114e35908d74a8d9f25f2dfa9b120427a0a4b1c41"} Jul 01 19:29:45.294005 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:45.293967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-dbjnp" event={"ID":"bfa993ec-0c57-45f8-827c-6b1b84b4b517","Type":"ContainerStarted","Data":"3d3e74ddf8fd825da1ed85e66a4a78646f712d1d27dc61776dc5b9615112f991"} Jul 01 19:29:45.294382 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:45.294090 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:29:45.312546 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:45.312499 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-dbjnp" podStartSLOduration=2.11124248 podStartE2EDuration="4.312485148s" totalImagesPullingTime="2.201242668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:29:45.310656236 +0000 UTC m=+409.456629978" watchObservedRunningTime="2026-07-01 19:29:45.312485148 +0000 UTC m=+409.458458889" Jul 01 19:29:56.302920 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:29:56.302895 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-dbjnp" Jul 01 19:30:31.788732 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:31.788651 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:30:56.808969 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:56.808921 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69db8b5798-s2p7l" podUID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" containerName="console" containerID="cri-o://99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235" gracePeriod=15 Jul 01 19:30:57.055117 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.055095 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168098 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168227 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168269 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168306 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rpsh\" (UniqueName: \"kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168386 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.168446 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert\") pod \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\" (UID: \"cc1eb342-38d0-4fdc-897e-ea2dddf284c0\") " Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.169213 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:30:57.169924 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.169573 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config" (OuterVolumeSpecName: "console-config") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:30:57.174794 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.174740 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:30:57.174932 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.174801 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:30:57.174932 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.174842 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 19:30:57.176535 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.176509 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 19:30:57.176625 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.176600 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh" (OuterVolumeSpecName: "kube-api-access-5rpsh") pod "cc1eb342-38d0-4fdc-897e-ea2dddf284c0" (UID: "cc1eb342-38d0-4fdc-897e-ea2dddf284c0"). InnerVolumeSpecName "kube-api-access-5rpsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:30:57.270144 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270105 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-oauth-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270144 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270136 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270144 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270149 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-oauth-config\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270161 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-trusted-ca-bundle\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270172 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-service-ca\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270184 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rpsh\" (UniqueName: \"kubernetes.io/projected/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-kube-api-access-5rpsh\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.270373 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.270195 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc1eb342-38d0-4fdc-897e-ea2dddf284c0-console-serving-cert\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:30:57.639577 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.639540 2563 generic.go:356] "Generic (PLEG): container finished" podID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" containerID="99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235" exitCode=0 Jul 01 19:30:57.639759 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.639597 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69db8b5798-s2p7l" Jul 01 19:30:57.639759 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.639599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db8b5798-s2p7l" event={"ID":"cc1eb342-38d0-4fdc-897e-ea2dddf284c0","Type":"ContainerDied","Data":"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235"} Jul 01 19:30:57.639759 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.639710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69db8b5798-s2p7l" event={"ID":"cc1eb342-38d0-4fdc-897e-ea2dddf284c0","Type":"ContainerDied","Data":"e6a4c8adeb829b1420de90f1bbba901de4f12370ef08d57195b1e24c1be34ce0"} Jul 01 19:30:57.639759 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.639736 2563 scope.go:117] "RemoveContainer" containerID="99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235" Jul 01 19:30:57.649040 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.649023 2563 scope.go:117] "RemoveContainer" containerID="99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235" Jul 01 19:30:57.649301 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:30:57.649281 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235\": container with ID starting with 99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235 not found: ID does not exist" containerID="99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235" Jul 01 19:30:57.649367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.649309 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235"} err="failed to get container status \"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235\": rpc error: code = NotFound desc = could not find container \"99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235\": container with ID starting with 99264736d4551eb56954954652a5b279533778e56dd7d80d5e1689e25c402235 not found: ID does not exist" Jul 01 19:30:57.669848 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.669816 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:30:57.675401 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:57.675377 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69db8b5798-s2p7l"] Jul 01 19:30:58.289847 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:30:58.289815 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" path="/var/lib/kubelet/pods/cc1eb342-38d0-4fdc-897e-ea2dddf284c0/volumes" Jul 01 19:31:17.973730 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.973698 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:17.974316 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.974280 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" containerName="console" Jul 01 19:31:17.974316 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.974302 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" containerName="console" Jul 01 19:31:17.974431 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.974412 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1eb342-38d0-4fdc-897e-ea2dddf284c0" containerName="console" Jul 01 19:31:17.976665 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.976646 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:17.979068 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.979049 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 01 19:31:17.985607 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:17.985584 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:18.146914 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.146857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq6hb\" (UniqueName: \"kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.147074 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.146965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.247457 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.247375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq6hb\" (UniqueName: \"kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.247457 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.247442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.247855 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.247836 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.256488 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.256463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq6hb\" (UniqueName: \"kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb\") pod \"seaweedfs-tls-custom-6644bf5d6c-4d8ls\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.286336 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.286307 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:18.414680 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.414659 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:18.416720 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:31:18.416695 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb114a68_2875_4a43_b608_ee36ff64c841.slice/crio-3a838993c41dd251d9fb55567791653c4f75e1d251a4d839a2249b62e84a6f81 WatchSource:0}: Error finding container 3a838993c41dd251d9fb55567791653c4f75e1d251a4d839a2249b62e84a6f81: Status 404 returned error can't find the container with id 3a838993c41dd251d9fb55567791653c4f75e1d251a4d839a2249b62e84a6f81 Jul 01 19:31:18.745023 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:18.744985 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" event={"ID":"db114a68-2875-4a43-b608-ee36ff64c841","Type":"ContainerStarted","Data":"3a838993c41dd251d9fb55567791653c4f75e1d251a4d839a2249b62e84a6f81"} Jul 01 19:31:19.751380 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:19.751343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" event={"ID":"db114a68-2875-4a43-b608-ee36ff64c841","Type":"ContainerStarted","Data":"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b"} Jul 01 19:31:19.766959 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:19.766917 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" podStartSLOduration=2.392352006 podStartE2EDuration="2.766901412s" totalImagesPullingTime="374.549406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 19:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:31:19.766408973 +0000 UTC m=+503.912382713" watchObservedRunningTime="2026-07-01 19:31:19.766901412 +0000 UTC m=+503.912875146" Jul 01 19:31:20.537807 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:20.537773 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:21.762492 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:21.762455 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" podUID="db114a68-2875-4a43-b608-ee36ff64c841" containerName="seaweedfs-tls-custom" containerID="cri-o://f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b" gracePeriod=30 Jul 01 19:31:49.510565 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.510541 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:49.623850 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.623780 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq6hb\" (UniqueName: \"kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb\") pod \"db114a68-2875-4a43-b608-ee36ff64c841\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " Jul 01 19:31:49.623850 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.623820 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data\") pod \"db114a68-2875-4a43-b608-ee36ff64c841\" (UID: \"db114a68-2875-4a43-b608-ee36ff64c841\") " Jul 01 19:31:49.625096 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.625072 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data" (OuterVolumeSpecName: "data") pod "db114a68-2875-4a43-b608-ee36ff64c841" (UID: "db114a68-2875-4a43-b608-ee36ff64c841"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 19:31:49.625977 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.625950 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb" (OuterVolumeSpecName: "kube-api-access-lq6hb") pod "db114a68-2875-4a43-b608-ee36ff64c841" (UID: "db114a68-2875-4a43-b608-ee36ff64c841"). InnerVolumeSpecName "kube-api-access-lq6hb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 19:31:49.725281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.725249 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq6hb\" (UniqueName: \"kubernetes.io/projected/db114a68-2875-4a43-b608-ee36ff64c841-kube-api-access-lq6hb\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:31:49.725281 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.725275 2563 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db114a68-2875-4a43-b608-ee36ff64c841-data\") on node \"ip-10-0-134-25.ec2.internal\" DevicePath \"\"" Jul 01 19:31:49.904770 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.904684 2563 generic.go:356] "Generic (PLEG): container finished" podID="db114a68-2875-4a43-b608-ee36ff64c841" containerID="f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b" exitCode=0 Jul 01 19:31:49.904770 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.904731 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" Jul 01 19:31:49.905005 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.904768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" event={"ID":"db114a68-2875-4a43-b608-ee36ff64c841","Type":"ContainerDied","Data":"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b"} Jul 01 19:31:49.905005 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.904817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls" event={"ID":"db114a68-2875-4a43-b608-ee36ff64c841","Type":"ContainerDied","Data":"3a838993c41dd251d9fb55567791653c4f75e1d251a4d839a2249b62e84a6f81"} Jul 01 19:31:49.905005 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.904838 2563 scope.go:117] "RemoveContainer" containerID="f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b" Jul 01 19:31:49.917554 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.917534 2563 scope.go:117] "RemoveContainer" containerID="f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b" Jul 01 19:31:49.917838 ip-10-0-134-25 kubenswrapper[2563]: E0701 19:31:49.917818 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b\": container with ID starting with f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b not found: ID does not exist" containerID="f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b" Jul 01 19:31:49.917927 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.917846 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b"} err="failed to get container status \"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b\": rpc error: code = NotFound desc = could not find container \"f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b\": container with ID starting with f5a1c8ef99e6ebfd3c6a85f100120a1644da48328835afe915e8667bfe33c00b not found: ID does not exist" Jul 01 19:31:49.926882 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.926860 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:49.930339 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:49.930321 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-4d8ls"] Jul 01 19:31:50.290551 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:31:50.290510 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db114a68-2875-4a43-b608-ee36ff64c841" path="/var/lib/kubelet/pods/db114a68-2875-4a43-b608-ee36ff64c841/volumes" Jul 01 19:32:56.267948 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:32:56.267920 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:32:56.268484 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:32:56.268396 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:37:56.301550 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:37:56.301522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:37:56.301550 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:37:56.301537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:42:56.332249 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:42:56.332217 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:42:56.334382 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:42:56.334360 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:47:56.362796 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:47:56.362768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:47:56.365379 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:47:56.365358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:48:05.820666 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:05.820639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lcpjl_ad8ff365-a7c7-437f-a1ed-5f8a7c29abc1/global-pull-secret-syncer/0.log" Jul 01 19:48:05.959277 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:05.959249 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wk8b7_0ce27da5-348e-495a-b1dd-cc7ebb70ac9a/konnectivity-agent/0.log" Jul 01 19:48:06.080371 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:06.080297 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-25.ec2.internal_15f196c730bb2d51f2a3cacfe68d0520/haproxy/0.log" Jul 01 19:48:10.191815 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.191785 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/alertmanager/0.log" Jul 01 19:48:10.244160 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.244130 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/config-reloader/0.log" Jul 01 19:48:10.273059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.273030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/kube-rbac-proxy-web/0.log" Jul 01 19:48:10.305681 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.305654 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/kube-rbac-proxy/0.log" Jul 01 19:48:10.336813 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.336788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/kube-rbac-proxy-metric/0.log" Jul 01 19:48:10.370854 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.370829 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/prom-label-proxy/0.log" Jul 01 19:48:10.403368 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.403344 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02c47b8b-0d42-4403-a897-02477a524135/init-config-reloader/0.log" Jul 01 19:48:10.449823 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.449747 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-cpc74_23a58980-1db2-41a9-8f73-92e54d52b062/cluster-monitoring-operator/0.log" Jul 01 19:48:10.589075 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.589041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-784b76946-pc5n2_ecdb0e88-8c98-4e6c-b137-cdb343138d82/metrics-server/0.log" Jul 01 19:48:10.770388 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.770361 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wdqq_f5fd2253-4915-427e-8eac-9dbff4acdfc4/node-exporter/0.log" Jul 01 19:48:10.858585 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.858562 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wdqq_f5fd2253-4915-427e-8eac-9dbff4acdfc4/kube-rbac-proxy/0.log" Jul 01 19:48:10.904563 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:10.904535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8wdqq_f5fd2253-4915-427e-8eac-9dbff4acdfc4/init-textfile/0.log" Jul 01 19:48:11.057748 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.057675 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rnw8r_fd01cc65-339f-4973-96ac-364303923f6f/kube-rbac-proxy-main/0.log" Jul 01 19:48:11.082029 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.082005 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rnw8r_fd01cc65-339f-4973-96ac-364303923f6f/kube-rbac-proxy-self/0.log" Jul 01 19:48:11.112064 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.112041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-rnw8r_fd01cc65-339f-4973-96ac-364303923f6f/openshift-state-metrics/0.log" Jul 01 19:48:11.457494 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.457466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-hjgrf_c2ef31ae-d08a-4e31-bd25-644f261adfec/prometheus-operator/0.log" Jul 01 19:48:11.491910 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.491867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-hjgrf_c2ef31ae-d08a-4e31-bd25-644f261adfec/kube-rbac-proxy/0.log" Jul 01 19:48:11.523408 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.523383 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-fhtp5_622f5aa3-8ada-48f6-a817-15799895eb24/prometheus-operator-admission-webhook/0.log" Jul 01 19:48:11.563909 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.563867 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fdd86d45c-m8c42_c07c1354-9037-4a2b-8fc8-6adcdc62f72c/telemeter-client/0.log" Jul 01 19:48:11.601143 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.601114 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fdd86d45c-m8c42_c07c1354-9037-4a2b-8fc8-6adcdc62f72c/reload/0.log" Jul 01 19:48:11.630013 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.629984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fdd86d45c-m8c42_c07c1354-9037-4a2b-8fc8-6adcdc62f72c/kube-rbac-proxy/0.log" Jul 01 19:48:11.667818 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.667751 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/thanos-query/0.log" Jul 01 19:48:11.696424 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.696399 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/kube-rbac-proxy-web/0.log" Jul 01 19:48:11.724792 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.724771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/kube-rbac-proxy/0.log" Jul 01 19:48:11.756292 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.756268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/prom-label-proxy/0.log" Jul 01 19:48:11.786423 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.786386 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/kube-rbac-proxy-rules/0.log" Jul 01 19:48:11.814705 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:11.814678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-796b799fd7-hvmdq_188a89fe-ebfb-4f19-9076-f57548f3eb27/kube-rbac-proxy-metrics/0.log" Jul 01 19:48:12.884217 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:12.884184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-lpw6b_34d67ecd-ea72-4364-bca0-52509eda3362/networking-console-plugin/0.log" Jul 01 19:48:13.466061 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.466026 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr"] Jul 01 19:48:13.466485 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.466467 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db114a68-2875-4a43-b608-ee36ff64c841" containerName="seaweedfs-tls-custom" Jul 01 19:48:13.466574 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.466489 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db114a68-2875-4a43-b608-ee36ff64c841" containerName="seaweedfs-tls-custom" Jul 01 19:48:13.466627 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.466604 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="db114a68-2875-4a43-b608-ee36ff64c841" containerName="seaweedfs-tls-custom" Jul 01 19:48:13.469779 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.469759 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.472182 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.472161 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26hz8\"/\"kube-root-ca.crt\"" Jul 01 19:48:13.472280 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.472183 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-26hz8\"/\"openshift-service-ca.crt\"" Jul 01 19:48:13.472991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.472977 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-26hz8\"/\"default-dockercfg-9bjq5\"" Jul 01 19:48:13.481313 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.481292 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr"] Jul 01 19:48:13.590032 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.589995 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-lib-modules\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.590233 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.590050 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-proc\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.590233 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.590138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-podres\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.590233 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.590206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-sys\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.590369 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.590233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zc7v\" (UniqueName: \"kubernetes.io/projected/af32150f-79c8-45ed-b9a1-185b7c24f780-kube-api-access-7zc7v\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691446 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-lib-modules\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-proc\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691485 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-podres\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-sys\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zc7v\" (UniqueName: \"kubernetes.io/projected/af32150f-79c8-45ed-b9a1-185b7c24f780-kube-api-access-7zc7v\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691538 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-proc\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691606 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-lib-modules\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691839 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-podres\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.691839 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.691641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af32150f-79c8-45ed-b9a1-185b7c24f780-sys\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.699991 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.699964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zc7v\" (UniqueName: \"kubernetes.io/projected/af32150f-79c8-45ed-b9a1-185b7c24f780-kube-api-access-7zc7v\") pod \"perf-node-gather-daemonset-ktpfr\" (UID: \"af32150f-79c8-45ed-b9a1-185b7c24f780\") " pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.780108 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.780081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:13.890192 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.890166 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-w4vgh_d7d98e41-7110-43e3-b4c4-2e52e19db929/download-server/0.log" Jul 01 19:48:13.930211 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:13.930191 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr"] Jul 01 19:48:13.932390 ip-10-0-134-25 kubenswrapper[2563]: W0701 19:48:13.932365 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf32150f_79c8_45ed_b9a1_185b7c24f780.slice/crio-e284dd245ab72d11215a8266d6bc198915d75c09b3f0b0ef72f784aeb68d6b41 WatchSource:0}: Error finding container e284dd245ab72d11215a8266d6bc198915d75c09b3f0b0ef72f784aeb68d6b41: Status 404 returned error can't find the container with id e284dd245ab72d11215a8266d6bc198915d75c09b3f0b0ef72f784aeb68d6b41 Jul 01 19:48:14.462006 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:14.461926 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-tf4gt_e2e165d2-6775-4f23-9444-6fa8eec817f6/volume-data-source-validator/0.log" Jul 01 19:48:14.619274 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:14.619236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" event={"ID":"af32150f-79c8-45ed-b9a1-185b7c24f780","Type":"ContainerStarted","Data":"b8f87a49648d12aad89b7d2cbb7da53dbe27de3c501ad95feedd6d7528ef01d6"} Jul 01 19:48:14.619460 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:14.619297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" event={"ID":"af32150f-79c8-45ed-b9a1-185b7c24f780","Type":"ContainerStarted","Data":"e284dd245ab72d11215a8266d6bc198915d75c09b3f0b0ef72f784aeb68d6b41"} Jul 01 19:48:14.619460 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:14.619384 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:14.635510 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:14.635460 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" podStartSLOduration=1.635446338 podStartE2EDuration="1.635446338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 19:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 19:48:14.634550422 +0000 UTC m=+1518.780524189" watchObservedRunningTime="2026-07-01 19:48:14.635446338 +0000 UTC m=+1518.781420079" Jul 01 19:48:15.440062 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:15.440013 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fgjzg_e1970e54-c8a9-48ab-bb1a-22c7740071c7/dns/0.log" Jul 01 19:48:15.469276 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:15.469244 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fgjzg_e1970e54-c8a9-48ab-bb1a-22c7740071c7/kube-rbac-proxy/0.log" Jul 01 19:48:15.629603 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:15.629572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxzvw_ce2fa894-79d5-4a6c-bfda-29dbb9b3f6ad/dns-node-resolver/0.log" Jul 01 19:48:16.140568 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:16.140544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fd8f2_cf98f927-aeec-411e-8453-48e276a013b0/node-ca/0.log" Jul 01 19:48:17.515627 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:17.515554 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xsq8v_25f29a38-ccf8-4aa5-8b88-7125295b8e6b/serve-healthcheck-canary/0.log" Jul 01 19:48:17.911377 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:17.911292 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-c4nzb_b4a45f67-7c52-48a3-b8c3-52833d2d0c7c/insights-operator/0.log" Jul 01 19:48:17.911509 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:17.911384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-c4nzb_b4a45f67-7c52-48a3-b8c3-52833d2d0c7c/insights-operator/1.log" Jul 01 19:48:17.935939 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:17.935921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wzcv_4b752549-961e-49a0-b8c5-07a299dfa4b3/kube-rbac-proxy/0.log" Jul 01 19:48:17.968781 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:17.968760 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wzcv_4b752549-961e-49a0-b8c5-07a299dfa4b3/exporter/0.log" Jul 01 19:48:18.003575 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:18.003549 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wzcv_4b752549-961e-49a0-b8c5-07a299dfa4b3/extractor/0.log" Jul 01 19:48:20.344173 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:20.344145 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-cjvtg_fd296ecc-7a63-4fa6-9568-d699558a0938/manager/0.log" Jul 01 19:48:20.369920 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:20.369894 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-dbjnp_bfa993ec-0c57-45f8-827c-6b1b84b4b517/server/0.log" Jul 01 19:48:20.634120 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:20.634054 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-26hz8/perf-node-gather-daemonset-ktpfr" Jul 01 19:48:20.647888 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:20.647848 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-4rjhl_f1565f5d-c901-4d00-91bb-c3527cbc50ce/seaweedfs/0.log" Jul 01 19:48:25.784250 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:25.784221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-kd5j6_13f53e22-1c5e-4d24-b391-669ee21b5a3f/kube-storage-version-migrator-operator/1.log" Jul 01 19:48:25.785121 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:25.785099 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-kd5j6_13f53e22-1c5e-4d24-b391-669ee21b5a3f/kube-storage-version-migrator-operator/0.log" Jul 01 19:48:26.818706 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.818679 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/kube-multus-additional-cni-plugins/0.log" Jul 01 19:48:26.844672 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.844641 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/egress-router-binary-copy/0.log" Jul 01 19:48:26.871377 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.871350 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/cni-plugins/0.log" Jul 01 19:48:26.897704 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.897683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/bond-cni-plugin/0.log" Jul 01 19:48:26.922598 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.922578 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/routeoverride-cni/0.log" Jul 01 19:48:26.952729 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.952701 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/whereabouts-cni-bincopy/0.log" Jul 01 19:48:26.976220 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:26.976197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hvt5n_d4747c29-a163-4616-9373-f0e6545d3f6b/whereabouts-cni/0.log" Jul 01 19:48:27.440383 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:27.440336 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ggsps_6e7caaa8-3887-4146-b2a8-f61eb06c6351/kube-multus/0.log" Jul 01 19:48:27.461651 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:27.461628 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bt4tw_c3327b66-7666-4066-9d83-8af7c759a53f/network-metrics-daemon/0.log" Jul 01 19:48:27.485372 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:27.485347 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bt4tw_c3327b66-7666-4066-9d83-8af7c759a53f/kube-rbac-proxy/0.log" Jul 01 19:48:28.712059 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.712023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-controller/0.log" Jul 01 19:48:28.761771 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.761742 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/1.log" Jul 01 19:48:28.761961 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.761740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovn-acl-logging/0.log" Jul 01 19:48:28.787330 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.787307 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/kube-rbac-proxy-node/0.log" Jul 01 19:48:28.815311 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.815284 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 19:48:28.846367 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.846348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/northd/0.log" Jul 01 19:48:28.871913 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.871892 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/nbdb/0.log" Jul 01 19:48:28.902269 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.902254 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/sbdb/0.log" Jul 01 19:48:28.954453 ip-10-0-134-25 kubenswrapper[2563]: I0701 19:48:28.954428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dd4gr_2dfd2119-0194-4538-baca-4512b4dc4e76/ovnkube-controller/0.log"